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THE VALUE OF THE SPOKEN RESPONSE IN TEACHING LISTENING SKILLS 
TO YOUNG CHILDREN THROUGH PROGRAMMED INSTRUCTION 

SUMMARY 



Problem 



The central purpose of this investigation was to determine how much 
kindergarten children can profit from speaking out loud during instruction 
designed to teach them to listen and to understand orally-presented infor- 
mation. The study was also directed at throwing greater light on the use 
of programmed instruction in developing young children's listening skills 
involving certain function words. 

The rapidly increasing number of studies dealing with the acquisition 
of language* by young children has focused attention upon the relationship 
between speaking the language and understanding It. In particular, several 
studies have highlighted the Importance of the period from ages four t > 
seven for language acquisition. During this Interval the young child learns 
not only to speak and to understand, but to listen to his own speech. In 
this process of learning to understand and listen, the role of speaking may 
be of critical importance. The question then is whether young children can 
profit by speaking aloud when they are learning to understand what they hear. 

Another way of approaching this question is in terms of the Issue of 
overt versus covert responding, which has received so much attention in recent 
years. The investigation, therefore, may also be looked upon as a study of 
response mode with young children. Althougjh there has been a large amount of 
research on this question, the vast majority of the studies have failed to 
find any value in instructing the students to respond overtly; having the stu- 
dents "think" the answer to each frame appears to be enough. 

Since the subjects involved in these experiments have Invariably been 
much older, usually at the secondary or adult levels, such findings do not pre- 
clude the possibility that an overt, spoken response is critically important 
with young children. There is some evidence that young children do profit from 
overt speaking, with the facilitating effect diminishing with age. While it is 
possible that preschool children can learn to understand information simply by 
"listening carefully", it seems likely that they would profit far more by the 
requirement that they speak out loud. This process may be related to that of 
the internalization of speech, which begins with overt speaking behavior and 
concludes with silent speech. The work of Vygotsky and Luria, for example, has 
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indicated the intimate relationship between overt speech and thinking. By 
systematically providing for this type of language practice the child may e 
helped to acquire an ability to process information and thus demonstrate an 
understanding of what has been said. 

To achieve this objective, instructional materials were designed to cap- 
ture the imagination of the child, provide pleasurab le ''activities and. 7 c t be 
practical for use in the regular classroom. The program was prepared so as 
to be highly replicable; the commentary was prerecorded on magnetic tape, and 
included pBDgrammed picture books as well as carefully sequenced games with 
manipulanda. In this way it was possible to assess the value of requiring 
overt speaking responses during programmed learning with young children under 
classroom conditions with a precision approaching laboratory standards. 

Hypothesis 

It was the purpose of this investigation to determine the value of having 
young children speak out loud during programmed instruction designed to teach 
them to listen and to understand new information dealing with conceptual rules 
and subject content. A subsidiary purpose was to develop programmed- materials 
to introduce new language curricula with this lower class population of young 
children. 

The Studies 

Following the introduction and te view of the literature in Chapter 1, 
there .are six chapters each of which reports a separate but related stu y. 



To examine Bemstein*s hypothesis that children from deprived environments 
show a deficiency in their understanding and use of function words, the fii^st 
§tudy (reported in Chapter 2) used a test of immediate memory oyer three word 
classes: nouns, verbs, and function wordse The subjects were c 1 ren n 

kindergarten, first, and second grades, from both lower and middle class 
Following a digit span test format, this instrument required children to repeat 
increasingly longer lists of words. While compared to the middle class group 
the lower class children were inferior on each word class, the deficiency was 
significantly greater with the function words, thus supporting Bernste n s 

hypothesis. 



The second study (see Chapter 3) compared the success with which middle 
class and lower class kindergarten children were able to apply four conceptual 
rules (affirmation, negation, conjunction, disjunction) when the directions 
were given in four different statement formats: declarative, interrogative, 

and imperative sentences, as well as key-word phrases. 



Each of the 60 subjects was given four test sessions on successive days, 
with a total of 160 items. For each item, the subjects heard a rule and were 
required to select from two or three alternatives the picture which matched 
that rule. The data showed that middle class kindergartners did much better 
when the instructions were expressed as interrogative or declarative sentences, 
while the lower class children did relatively better with the key word phrases. 
Using a Latin Squares repeated measures design, the interacti^^ of socioeconomic 
class and sentence forma, was significant at the .05 level. The fin ng 
gests that, compared with middle class youngsters, lower class children are less 
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apt to profit from complete sentences and may even do better with sentence 
fragments , perhaps because their prior language experience has not involved 
a rich, -/ell-developed s“>ntence structure. 

Chapter 4 presents the third investigation, in which the effect of in- 
structing kindergarten children to speak out loud appropriate and inappropriate 
words during a selective learning task was explored. The study was carried out 
with 42 five-year-old children frcm lover socioeconomic class homes. For each 
problem, the child wa.. presented with a series of five cards. Each of 
ca^ds showed three sizes oZ the same object, wxth the location of the different- 
sized pictures randomly arranged on the successive cards. For each card, t e 
child was required to point to the right sized picture, and was given knowledge 
of results when he did so. Children had to find the right picture before pro- 
ceeding to the ae;:t card. 

All children were given preliminary training in supplying the appropriate 
label. Mg, medium or little , with a set of pretest pictures. They were then 
assigned at random to an attribute labeling group, a non-labeiiug group, and 
an object labeling group. Children in the attribute labeling group were taught 
to label the size of the picture which they selected each time; children in the 
object labeling group named the object, a word which, while appropriate to the 
picture, did net. help the child solve the problem. The non-labeling group 
simply pointed to the correct picture. The children who provided the appro- 
priate attribute labels obtained higher scores during training than either of 
the other two groups. On a posttest involving the same dimensions but with no 
instructions to verbalize, children who had received attribute training per- 
formed significantly higher than those who had vocalized the object labels. 

The e data were interpreted as indicating that vocalizing object labels could 
product interference, a finding reported earlier by Tracy Kendler. 

The fourth study is an attempt fo assess the major hypothesis through the 
use of informal classroom materials. A replication of an earlier experiment 
was carried out to compare oral and non-oral methods of teaching beginning 
reading. Over a two-week period, 92 kindergarten children were taught to read 
20 individual words, as well as those same words in sh.ort phrases d.nd sentences 
The contexts in which the skill was demonstrated included matching a cue word 
at the top of the page, to one of three words at the bottom, finding a printed 
word from an oral cue with no written cue, matching a picture to the proper 
word in a sequence of pointed words, and completing missing word sentences by 
indicating which one of three words would best complete the sentence, ^ile 
all subjects were required to make a choice on each item, only the children in 
the oral group were instructed to say the correct word aloud. 

The value of the oral response under informal instructional conditions 
was demonstrated on the posttest, where the oral group was superior to the non- 
oral group even though no instructions to vocalize were given and the task 
consisted entirely of silent reading. This replicated experiment is reported 

in Chanter 5. 

In studies of concept learning, subje-ts are generally required to dis- 
cover the concept-defining rule. In schools, however, children are usually 
given the rule which defines the concept and are then expected to use this 
information in identifying positive and negative instances of the concept. 



The purpose of the investigation, reported in Chapter 6, was to determine 
whether children who are required to speak certain key words aloud are 
helped in learning conceptual rules so as to be able to apply them to new 
instances . 

In the first stage of this study, 12 children were randomly assigned 
to an oral group and a control. Subsequently, eight more children were 
given a non-oral treatment. All 20 children were enrolled in a Children’s 
Center and were between 58-62 months of age. The instructional program 
consisted of eight daily lessons approximately 8-12 minutes each. 

For each deductive problem in the instruction and the criterion tests, 
■five items involving the same rule were used. The child was told a story 
in which a missing object or person had to be found. The clue was given 
in the form of a description (i.e., defining rule) which the child then used 
as a basis for selecting one of three pictures which might be the missing 
object (the positive exemplar). The problems involved four of the most 
important types of conceptual rules (drawn from Bourne's list of 10); Nega- 
tion, conjunction, disjunction, and joint denial. An example of the latter 
would be: "Jimmy's sweater has no buttons and no sleeves." 



The pre- and posttests of rule application presented eight problems, 
each with five items, for the four types of rules. In addition, an "induc- 
tive" test required the children to identify positive instances in a concept- 
identification problem without being told the rule. 



In the first stage, the oral group was significantly superior to the 
control (p <.05). They were also dramatically superior with the "inductive" 
problems, which required the use of new conceptual rules. No reliable dif- 
ferences to support the value of oral rehearsal was obtained. However, like 
the oral group, the non-oral group was superior on the inductive test. Such 
evidence of transfer suggests the value of this type of training with young 
children. 

The final experiment, presented in Chapter 7, was designed to determine 
whether disadvantaged children learn to use sentential connectives and quan- 
tifiers more effectively when they speak aloud the key words in problem 
solving tasks. A related question was whether they could learn to withhold 
judgment when they had not been given sufficient information. 

Two methods of instruction were tested, using 120 lower class kinder- 
garten children. After pretesting, the subjects were blocked on two levels 
of mental age, and randomly assigned to one of three treatments; (1) a non- 
oral group listened to taped commentary and responded by selecting the 
appropriate one of three pictures j (2) an oral group listened to the same 
commentary but was required to speak aloud the relevant verbal cues before 
selecting the picture; and (3) an uninstructed control. Over an 11 week 
period, groups of five or six children were given daily programmed lessons, 
each lasting approximately 12 minutes. Booklets with special feedback ink 
and, occasionally, demonstrations and games requiring manipulanda, were used. 



Phase 1 of the program taught children to say "Can't tell in situations 
where there was insufficient information to warrant a Yes or No response. 
Phase 2 was a sequence of lessons about the octopus; and Phase 3 involved the 
application of conceptual rules using sentential connectives: not, and, and or. 
Pre- and posttests were individually administered to all children. 

The results indicated that the instructed groups were reliably superior 
(od.OOl) to the controls in the use of quantifiers and connectives. However, 
tLching children not to guess (l.e., to say. "Can’t tell" when given insuf- 
ficient information) was a difficult task, under either treatment condition. 
Finally, it was demonstrated that the oral group was reliably ^uperior to the 
non-orai in learning the nature study concepts. 

No differences were found between the two instructed groups when no clear 
cueing function was provided by the. words spoken aloud. On the general lis- 
tening tests, the non-oral grouprwas superior to the oral group, providing 
some evidence that requiring children to speak aloud can cause interference 
when the test situation is quite different from the training. 

Conclusions 

The findings from the various studies lead to a number of conclusions 
discussed in Chapter 8. With respect to the value of the oral response during 
instruction, the general implication is that where there is a specific and 
direct association to be made, the speaking response has considerable value 
even though the criterion test involves no speaking whatsoever. This finding 
was supported in the reading study, where children who spoke the words aloud 
were better on a silent reading test which involved these same words than 
children who selected answers without speaking. 

The effect of the oral response was much less clear when the material was 
more complex. Where the critical words constituted only a part of the impor- 
tant information to be assimilate-: (e.g., function words or, not) the 

oral response, which was general! superior to the non-oral, produced sign - 
f leant differences in only one comparison. It would appear that having pupi 
Simply speak these sentences aoud is inadequate where the thought process is 
more complex. When greater understanding of the process involved is obtained, 
it may be possible to identify more accurately the critical ways instruction - 
should be presented within a speaking framework. 

There was some evidence that speaking aloud in a mechanical cueing fashion 
may lead to Interference when the child attempts to use this technique in new 
situations for which verbalization is not appropriate. For example. 
may be extremely familiar with material presented, or on the contrary, rehearses 
words or phrases which are not helpful and may produce interference. Practice 
with a wide variety of materials is an essential feature of the curriculum to 
reduce such negative transfer through increased discrimination and overlearning. 

An important contribution of the project to education was the development 
and evaluation of a number of replicable Instructional programs, accompanied 
by criterion test items. These products are currently being revised for use 
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on a longer range project* Such explorations of new curricular content for 
this age group demonstrate the potential value of teaching young children 
to withhold judgment where information is lacking and to become aware of 
the concept of possibilit;^ where the information given is inadequate, there 
is a possibility that either true or false may be correct and hence the 
appropriate response is "Can* t^- tell.'* The studies suggest that before a 
child develops a dichotomous way of thinking it may be helpful to teach him 
to deal with ambiguity and to recognize that frequently no definitive answer 
is possible. 

The studies also indicate that children can listen with understanding 
and respond appropriately to statements involv^g function words such as 
quantifiers, negation, and sentential connectiWs. In the schools children 
generally learn concepts deductively from rules given to them rather than 
through inductive discovery; it may be most desirable for many children, 
especially those with language deficiencies, to receive systematic practice 
in listening with comprehension to such rules. 
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Chapter 1 



INTRODUCTION 



The main focus of this project has been the improvement of the under 



standing of spoken language by lower class kindergarten children. This 
population was selected because recent research has indicated that there 
are important deficits in the performance on standard English tests with 
this group y compared to children from middle class homes. However » listen 
ing skills are basic to the comprehension of spoken language, which con- 
stitutes a prerequisite to adequate school performance regardless of socio 
economic level. 







The first concern of the study was to identify areas where young chil- 
dren might be deficient in listening skills; a second focus was on the pre- 
paration and evaluation of instructional programs for the improvement of 
these skills; and the third area of concern was with testing under class- 
room conditions a hypothesis, for which there is considerable laboratory 
support, regarding the value of having children speak aloud in rdeveloping 
these competencies. 



Following the guidelines of Basil Bernstein, who has pioneered in this 
area, the "little" but important function words have been the focus of the 
"listening" instruction. Thus the major emphasis has been on teaching chil- 
dren to listen with comprehension to oral communications which involve nega- 
tion (no, not), verbal quantifiers (all, some, none), or sentential connec- 
tives (and, or). To supply additional areas for the testing of the oral 
"iH^sponse hypothesis, specific types of content, (a nature study unit and a 
beginning reading program) were used in the course of the investigation. 



One of the important outcomes was the creation of interesting materials 
(such as picture books with taped commentary, manipulanda, and simple games) 
in the form of replicable instructional sequences. Equally important was 
the development of a series of tests for assessing the effectiveness of the 
programs. In line with the original proposal, these have subsequently been 
adapted for use in a parallel five-year language study with disadvantaged 
children, sponsored by the United States Office of Education (Project No. 

OE 5-85-045) . Thus the products of this investigation are already proving 
their usefulness in practical application. 



The value of having young children produce key words aloud is part of 
a broader question related to overt responding in general. Within the frame- 
work of programmed instruction a good deal of research has been carried out 
to test the hypothesis that overt responding improves learning more than 
"passive" viewing. Hovland, Lumsdaine, and Sheffield (1949) in an early study 
found that the overt vocal response aided soldiers in learning the military 
phonetic alphabet in comparison with passive viewing. The facilitation was 
gr©ater for less intelligent, less motivated subjects, as well as when the 
material was more difficult. 
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Working with 9th and lOth grade boys Gagne and Smith (1962) found 
that requiring subjects to verbalize during training resulted in superior 
performance throughout training and on the posttest ^ although individuals 
who verbalized took more time. The authors conclude that "requiring ^’s 
to verbalize during practice has the effect of making them think of new 
reasons for their moves, and thus facilitates both the discovery of 8®^” 
eral principles and their employment in solving successive problems." 

Most research, however, fails to support the notion that overt re- 
sponding produces more effective learning than simply watching and lis- 
tening. In a typical study (Goldbeck and Campbell, 1962) , ',juniorr high school 
students were given the same programmed unit, with one group writing the 
responses and the other group "thinking" them. Not only did the active 
responders fail to show a reliable superiority to the "passive" group, 
they took far more time to complete the program. Holland (1966) points 
out that such studies are generally of short duration and do not allow 
the covert responders to extinguish their behavior. Furthermore, he 
indicates that the response required must be relevant to the task, which 
is not always the case. 

Such investigations have often failed to consider that the value of 
overt responding may be much greater with younger children. Thus Keislar 
and McNeil (1962) found that first grade children who were required to 
make a multiple choice selection were not superior to children who were 
exposed to the same program with the correct answers identified. The 
real problem, however, hinges on the value of having young subjects speak 
aloud rather than merely select appropriate choices. In a subsequent study 
in the field of reading, McNeil and Keislar (1963) demonstrated the value 
of oral responding even when the criterion task was that of selecting a 
correct answer from among several alternatives. 

The place of overt speaking in learning has received a good deal of 
attention by psychologists studying the learning processes of young chil- 
dren. White (1965) has proposed that between the ages of five and seven 
a dramatic shift is made in the quality of the learning process on the 
part of young children. A crucial feature of this change deals with the 
way in which the child learns to talk to himself and respond to his own 
language . 

Luria (1961) found that before he is tx<70 years of age the child can- 
not use his own speech to control his behavior. By about three and a half, 
he can regulate his behavior through his own speech, although he is unable 
to use this verbalization to inhibit his actions. The child becomes fully 
able to control his behavior by his own speech at about five, when this 
control transfers from the child’s overt vocalizations to a covert level 
of speech. Since the young child’s tendency to verbalize spontaneously is 
weak, instructing him to respond verbally in a learning situation will often 
imp.'ove his performance. The older child has learned to supply his own 
verbal mediators . 

Basing his hypothesis on mediation theory, Reese (1962) suggests that 
children who have not yet learned to respond to their own speech cues are 
"mediationally deficient" and hence fail to demonstrate the sophisticated 
learning of older children. This point of view posits two alternative 
situations; cueing behavior may be so automatic that once children acquire 
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a v©rbal rsspons© it will serv© this function without furth©r tmining* 

On th© oth©r hand, childr©n may damonstrate this mediational function of 
language only after appropriate learning experiences. 

A good deal of research has demonstrated the value of teaching young 

children to apply a common label to a class of stimulus objects where sub- 

sequently the same response is to be learned to each member of this stimu- 
lus class. Birge (1941), Cantor (1955) and Norcross and Spiker (1957) have 

carried out three of the classic studies in this field. Such examples of 

verbally-mediated generalization have been found with young children best 
if the subjects are instructed to say the labels aloud. (Cf. Weir and 
Stevenson, 1959.) 

There is considerable evidence to support the notion that requiring 
young children to speak aloud can foster the use of verbal cueing. Kendler 
(1964) found, on a reversal shift problem, that kindergarten children who 
^ 0^0 ]^ 0 quired to speak aloud demonstrated superior performance in comparison 
with children who were not asked to speak the appropriate labels . Kendler , 
Kendler, and Garrick (1966) found that vocal labeling, where relevant, aided 
kindergarten children in solving inferential problems. Silverman (1966) 
found that relevant verbalization greatly facilitated learning on a reversal 
shift task with both three and four-year-old children, as well as seven and 
eight-year-old children. In his study Silverman required the children to 
continue the verbal responses during the criterion test. 

It is also quite possible that verbalization may serve as interference. 
Kendler, Kendler, and Garrick (1966) found that while having subjects say 
the labels aloud • helped kindergarten children, this procedure had a detri- 
mental effect at the third grade level. Rosenbaum (1967) had elementary 
school children explore a multiple choice maze. In one condition performers 
in the presence of observers called out numbers associated with the correct 
responses. In a second condition, the observers called out the nuinbers. In 
a third condition, no verbalization occurred. On a subsequent retention test 
observers were superior to performers, older children retained more than 
younger, and those who did not verbalize but heard another child call out the 
numbers, did better than subjects in other conditions. Rosenbaum concluded 
that his study "may be regarded as adding to the list of potentially inter- 
fering but frequently required responses, the necessity for active verbaliza- 
tion of the correct response." 

Flavell, Beach, and Ghinsky (1966) have drawn the distinction between a 
production deficiency and a mediation deficiency. Working with six and seven- 
year-old children, Keeney, Gannizzo, and Flavell (1967) identified children 
who rehearsed spontaneously during a recall task and those who did not rehearse. 
Although the non-rehearsers, when instructed to whisper the object names to be 
remembered, did as well as the spontaneous rehearsers, they failed to continue 
to rehearse when the requirement was lifted. These authors concluded that the 
major problem in teaching children to use their own language as cues does not 
lie in a mediational deficiency, but in a production deficiency. If children 
produce their own mediators they seem to have little problem in making use 
of them. Gratch (1966) also found that middle class children were not less 
deficient, as measured by spontaneous production, than lower class children. 
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McNeany and Keislar (1966) , presented 60 four-year-old children with 
a selective learning task involving size. The children who were given overt 
training with a consistent set of labels performed better during training 
and on a posttest than children who saw the same stimuli but were given no 
labeling training. This facilitation of verbal labeling training cannot 
be attributed simply to the fact that these subjects were given a new label 
to use, since the differences between treatment groups were larger on the 
problems where the correct answer involved very familiar labels. When 
the instructional program was expanded to involve pictures of different 
but related dimensions, no differences were found between the labeling 
and non-labeling groups. This may have been due to interfering effects 
between the four sets of labels ; children in the labeling group may have 
been confused as to which label they were required to use for a given 
stimulus. 

In this project, the major question was concerned with the value of 
the spoken response as an instructional procedure. That is, in order to 
teach a child to understand spoken language, is it important during in- 
struction to require him to say these words out loud? The effects of 
speaking aloud were assessed under a variety of conditions, ranging from 
tightly controlled tasks where a single word was all that was required, to 
situations where complex curricular materials were involved and the key 
words were always embedded in a sentence context. 

To test the major hypothesis an oral and a non-oral treatment were 
established. The subjects in both these groups responded throughout in- 
struction by answering multiple choice type questions, where a knowledge 
of results was consistently given. Just like the oral group, the non-oral 
group was required to pay attention to the relevant features of the problems 
posed and reinforced for doing so. Consequently, the difference between 
the treatments was not in terms of "active” versus "passive" but lay entirely 
in the fact that the oral group, in addition to the multiple choice response, 
was required to speak aloud the key words or sentence. 

The Problem 

The merits of overt verbalization may be greater if the response being 
vocalized is not part of the child's repertoire. Speaking aloud may be less 
Important for those children who have already; mastered .the words , either 
singly or in patterns, to be spoken. It is likely, therefore, that the ef- 
fect of overt verbalization would be greater in those cases where the re- 
sponse: was unfamiliar and had to be practiced in order to become part of the 
individual's repertoire. For young children, therefore, instructions to 
verbalize overtly seem to be effective in part because children all too fre-yf 
quently do not verbalize or rehearse what they are learning. Constant vo- • 

calization may well make it more likely that active rehearsing techniques f 

will be adopted by the child. On the other hand, there is the risk that ^ 
these covert behaviors may serve to Interfere with other types of learning. ^ 

Organization of Report 

The project has taken the form of a series of related and yet independent^ 
studies dealing with (1) identification of language problems in the attainment 
of listening skills, (2) construction of instruments to test achievement i.n , 
such areas, (3) development of programs to cultivate higher levels of listening 
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comprehension skills, and (4) testing of hypotheses regarding the value of 
oral responding in instructional programs. 



six studies are reported, each one presented as a 8eP®r“‘e 
The series of studies begins with the descriptive ‘^P'=®' 

2 and culminates' 1* a thrae-month experittent reported-as the ^^“®. . . , 

study in Chapter 7. Each of these six studies has either been published 
or hL been reported as a paper on the program of the annual meeting of 
American Educational Research Association of 1968 or 1969. 



In the first investigation, reported in Chapper 2, "Young 
Immediate Memory of Word Classes in Relation to Social ‘^J®®®* 
from lower class homes were compared with middle class children, 
hypothesis that lower class children show a greater relative ^®*^®^®“®y ^ 
their understanding of "function" words. These words, basic as they are to 
listening compreheLion, constitute the instructional goals in the subsequent 
chap“r^ A new instrument, analogous to a digit-span test, was developed 

and used for this study. 



The study reported in Chapter 3, "The Effect of Different Verbal Direc- 
tions upon the Application of Concept Defining Rules by mddle and 
Class Kindergarten Children." compares the abilities of lower ®lf® children 
with those of middle class children with respect to Je- 

rules under various kinds of sentence formats. Class differences in 
spondin^to negation and sentential connectives under different modes of pre- 
sentation of the tasks were explored. 



In Chapter 4, "Kindergarten Children’s Use of Vocal Labeling Responses 
in Problem Solving," the possible role of interference in vocalizing was 
assessed under three treatmentnconditions. Two oral groups ® 
t^vocalize labels aloud, while a third group was not required to label. The 
labels used by the first oral group were those which referred to , 

attributes, whereas the second oral group spoke the ^ ® ° ^ 

while aooropriate labels, did not serve as functional cues for the task. Tnis 
design made^it possible to test the effects of facilitation and interferenc 
under the two labeling conditions, in comparison with the non-labeling group. 



Chapter 5 presents a replication of an earlier investigation 
Keislar ^1963) in which the oral response proved to be dramatically effective 
if beSining reading. For the present study instructional materials which 
could^be easily adapted for regular classroom Cise, were developed, whereas 
the earlier experiment requited expensive teaching machine equi^ent. 
addition^ SKIng the hypothesis relative to the value of oral responding 

in this exceedingly important subject area, the mHhrb^ 

determine whether informal and flexible procedures, ’Ufiing ^ j 

"teacher-made" materials, could provide an acceptable level of preclson. 



The study reported in Chapter 6, "Training in Listening to and Applying 
Concept-defining Rules," compared oral and non-oral 

kindergarten children to listen to and use function words *5°*® 

sentences, ‘The child was expected “^respond to the use of negatio^ a^^ 
sentential connectives such as and and or by following ins u . . . 

for teaching children to apply simple conceptual rules ® deduc- 

is predicated on the fact that most school concepts are learned in this deduc 

tive fashion; laboratory experiments on concept learning a mos v y 

utilize inductive processes. 
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The final experiment of the project reported in Chapter 7, was carried 
out with a large group of subjects over almost a three-month period. The 
major hypothesis regarding the value of the oral response was tested by 
using two experimental groups as well as a control. A diversity of materials 
were incorporated into a series of units designed to assess the cumulative 
effect of vocalization in a curricular context. 

The subjects were taught not only to respond to negation and sentential 
connectives, as in Chapter 6, but they were required to interpret sentences 
involving the verbal quantifiers, all , some , and none , as well as always . 
sometimes, and never . An Important feature of this program was that these 
young children were taught not only to answer questions with ”Yes” or "No»'* 
but also to withhold judgment (i.e., to say "Can*t tell") when insufficient 
information was available. 

Chapter 8, is a discussion based on the results from all the studies, 
drawn together and interpreted in terms of contributions to theory and prac- 
tice in education. The conclusions are of two major types, one dealing pri- 
marily with the value of overt verbalization during listening instruction, 
and the second referring to the desirability of introducing nevy types of in- 
structional goals having to do with the development of listening skills in 
the kindergarten curriculum. 

Following the references, the various Appendixes present only a small 
portion of the voluminous amount of materials prepared and used during the 
course of the several investigations. These include copies of the criterion 
tests as well as sample lessons which illustrate how the Instruction was 
carried on:.and the differences between experimental treatments. 
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Chapter 2 



YOUNG CHILDREN’S IMMEDIATE MEMORY , 
OF WORD CLASSES IN RELATION TO SOCIAL CLASS 



Of all the recent literature relating to social class differences in 
language, perhaps no sii^gle theoretical formulation has stirred more inter- 
est than that of Basil Bernstein (1960, 1961). Although many researchers 
have suggested that there is a functional difference between the lower and 
middle class cultures in "standard" language usage (e.g. Deutsch, 1964; 
Thomas, Schutz and Keislar, 1968), Bernstein proposes an explanation for 
the apparent disparity. Essentially, he suggests that the lower class 
culture follows a "restricted" linguistic code which hipders the develop- 
ment of vocabulary and keeps thought at a low level of conceptualization. 
Bernstein proposes that if the lower class children were helped to acquire 
the "elaborative" linguistic code of the middle class, the measured intel- 
lect and academic "differences" betwedn the groups would largely disappear. 

To encourage research related to the theory, Bernstein has enumerated 
various hypotheses capable of investigation. For example, it is alleged 
that one important distinction is the relative inferiority of the lower 
class in the use of function words (i.e., conjunctions that complete sen- 
tences, negation, etc.). More specifically, Bernstein (1959) states: 

Because of a simple sentence construction, and the fact that 
a public (’restricted)) language does not permit the use of 
conjunctions which serve as important logical distributors of 
meaning and sequence, a public language will be one in which 
logical modification and stress can on^y be crudely rendered 
linguistically. This necessarily affects the length and type 
oftthe completed thought. Of equal importance, the reliance 
on a small group of conjunctions. . .often means that a wrong 
conjunction is used or an approximate term is constantly sub- 
stituted for a more exact logical distinction. 

If Bernstein’s hypothesis is correct (i.e., that the lower class 
child is particularly deficient with function words due to environmental 
deprivation) , then presumably young lower class children have the same 
deficiency with function words as do middle class children who are some- 
what younger. A number of research strategies are available to determine 
if this is indeed the case. One approach would be that most often employed 
by the descriptive linguists: simply study the child’s everyday speech and 
record the function words as they occur. For example, using this technique 
Brown and Berko (1960) observed that children showed an increasing ability 



^A version of this chapter was presented as a paper entitled, 
"Immediate Memory of Three Word Classes as a Function of Social Class 
and Grade", by Samuel R. Schutz and Evan R. Keislar, at the annual 
meeting of the American Educational Research Association, Chicago, 
February 1968. 
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with age to construct grammatically correct sentences using new words. 

The lack of experimental control inherent in this strategy presents grave 
although not insurmountable problems. However, another approach (and the 
one used in this study) has been employed by Brown and Eraser (1961) in 
which ji measure is obtained of the child’s ability to echo or repeat sen- 
tences ’jjhich he hears. The use of this echoic technique provides for a 
standardized exposure to sentence structures as desired. 

Employing the latter strategy, Brown and Fraser (1961) found that the 
number of word responses included in each separate sentence increased as 
the children grew older; in addition, they noticed that the speech of the 
younger children was systematically abbreviated. The latter finding led 
the authors to describe the speech of the children as "telegraphic English" 
and to attribute the increased ability to employ function words to an in- 
crease in "memory span." The investigators assumed, of course, that there 
is a high relationship between ease of repeating a given sentence and the 
subject’s familiarity with the words in the sentence. One: serious limi- 
tation of the Brown and Fraser study was the confounding of the word 
(morpheme) recall with the varying syntax of the respective sentences; 
that is, if an errot were made, it could not be determined whether this 
was due to the nature of the morphemes (word-class) or the nature of the 
syntactic construction, or both. 

In the present investigation, attention was focused solely on the 
child’s ability to echo words belonging to a certain word class; that is, 
the words were presented alone, without sentential constraint. In this 
way, syntax was eliminated as a confounding variable and any reliable dif- 
ferences could be attributed with confidence to the word classes. More 
specifically, the study reported here is a controlled comparison of lower 
and middle class children in ability to immediately recall function words, 
using two other word classes (nouns and verbs) as a control. In order to 
sample children of different ages, the test was administered at three 
successive grade levels (kindergarten, first, and second grade). It was, 
of course, expected that there would be differences between the two social 
classes and among the grades and word classes. The concern of the study, 
however, was with the interaction of SES with the other two variables. 
Consequently, the hypotheses are: 

Hypothesis 1: Deficiency in word recall of the lower class child is 

greater for function words than for either nouns or verbs in relation 
to the middle class child. 

Hypothesis 2: The difference between the social classes for recall 

of function words relative to recall of either nouns or verbs is 
larger for children in the older grades than for children in the 
younger grades. 

Method 



Children from two different schools, one middle and one lower class, 
were tested at the three grade levels. Social class was defined by the 
Los Angeles School district in terms of the communities in which the schools 
were located. The lower class was entirely Negro and had been earmarked as 
eligible for special poverty funds under ESEA; the middle class was entirely 
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Caucasian. In both schools, the Principal assigned one intact class for 
each of the grades. And, from these classes, 60 ^s were randomly selected 
for testing, 30 from each school and 10 from each grade. 

In preparing the test instrument , a sample of seven one— syllable 
words for each word class was selected from the 500 most frequent words 
in the original Thorndike count (Thorndike and Lorge, 1944), resulting 
in seven nouns, seven verbs, and seven function words. After obtaining 
this sample of words, the test was structured; it was essentially a word 
analog to the *'digit span" memory task. The test is fully reproduced in 
Table 1. It will be seen that the entire test contained six series, and 
each of the word classes was represented in every series such that there 
were two words per word class in series 1, three words per word class in 
series 2, continuing to seven words per word class in series 6. Care was 
taken that no list contained common homonyms or minimal pairs. 

The test was administered individually, and the order in which the 
items were presented is given in Table 1. E read each item at the rate 
of one word per second and ^ responded before going to the next Item. ^ 
read each item only once, and testing was discontinued for each word class 
when an error was made in that class. An error was defined as any omission, 
addition, or incorrect order. Note that once a person made an error for any 
word class, he was not given any longer lists within that word class to re- 
call. Ss* score for any word class was the longest list of words he could 
repeat without making an error. 

Resul^ and -Discussion 

The data were analysed using a 3 x 3 x 2 factorial design with one 
repeated factor (Winer, 1962). The results ^f this stu^y* arm presented > 
ift Tables 2 & 3: . The results relative to Hypothesis 1 are graphed in F1^7 
ure 1. It may be seen that the highly significant interaction betweem soc- 
ial class and word class (p<.01) is due to the relative inadequacy of the 
lower class with the function words. Hypothesis 1 is therefore supported. 

The results for each grade relative to Hypothesis 2 are separately 
graphed in Figure 2. The gap between the social classes on the function 
words is fairly consistent from one grade to the next. Nevertheless, the 
triple interaction (SES x word class x grade) falls short of significance 
and hence Hypothesis 2 is not supported. 

As was expected, the differences relative to each of the main effects 
(SES, word class, grade)were significant. Table 3 also shows a significant' 
Interaction between social class and grade; the differences between the 
classes are much greater in kindergarten than in the first and second grades. 
Since the overall differences between the first and second grades were so 
slight, it is possible that this tapering o£f may be due to a ceiling effect. 

The results of this study give considerable support to one aspect of 
Basil Bernstein’s theory of social class differences in language develop- 
ment, i.e., that the verbaluiefdLcienqy of lower class children is largest 
in function words. In addition, the findings of the present study suggest 
the utility of such an immediate memory instrument for otherr: Studies of 
language assessment. 
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TABLE 1 

A Test of Inmediate Memory for Three Word Classes 



Series 1: Two words per word class, 



Item 1; and 


of 






Item 2; boy 


chair 






Item 3; run 


swim 






Series 2; Three words per word 


1 class. 




Item 4; cup 


chair 


boy 




Item 5; of 


or 


and 




Item 6 ; swim 


hit 


run 




Series 3; Four words 


per word 


class. 




Item 7; fish 


boy 


chair 


cup 


Item 8; run 


build 


hit 


swim 


Item 9; and 


if 


or 


of 


Series 4; Five words 


per word 


class. 




Item 10; hit 


run 


swim 


grow 


Item 11; chair 


fish 


cup 


hat 


Item 12; or 


and 


of 


down 


Series 5; Six words 


per word 


class. 




Item 13; but 


and 


down 


if 


Item 14; hat 


chair 


fish 


boy 


Item 15; drive 


run 


grow 


buil 



Series 6; Seven words per word class. 



Item 16; tree 
Item 17; if 
Item 18; build 
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TABLE 3 




I 



Summary of Analysis of Variance 
for Scores on Test of Immediate Memory 



Source 

of Variation 


SS 


df 


MS 


F 


Between Subiects 


106.98 


59 


1.81 


1.39 


Social Class (A) 


9.80 


1 


9.80 


7.54** 


Grade (B) 


26.87 


2 


13.44 


10.34** 


A X B 


.04 


2 


.02 


— 


Error Between 


70.27 


54 


1.30 


— — — 


Within Subiects 


61.33 


120 


.51 


1.38 


Word Class (C) 


8.04 


2 


4.02 


10.84** 


A X C 


4.94 


2 


2.47 


6.68** 


B X C 


5.40 


4 


1.35 


3.65** 


A X B X C 


3.22 


4 


.81 


2.19 


Error Within 


39.73 


108 


.37 


- — 



■i 



I 



**Significant at the 



.01 level of confidence. | 
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12 




mm 










Mean Length of Longest List 
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Lower Class 
Middle Class 



Function Verb 



nJuiT 



WORD CLASS 

Figure 1. Mean Score by Word Class for Each Social Class 
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Chapter 3 



THE EFFECT OF DIFFERENT VERBAL DIRECTIONS UPON 



THE APPLICATION OF CONCEPT DEFINING RULES BY^ 



MIDDLE AND LOWER CLASS KINDERGARTEN CHILDREN 



The purpose of the investigation was to assess the abilities of 
kindergarten children to apply five different kinds of concept defining 
rules when verbal directions were given in four different sentence 
formats. The concept defining rules which were used by the children 
as a basis for selecting positive instances included affirmation, nega- 
tion. conjunction, disjunction and joint denial. The four sentence 
formats in which the directions were given included interrogative, 
imperative and declarative sentences, as well as incomplete sentences 
consisting of key word phrases. 



Bevlew of Related Research 



Comparisons of the verbal and conceptual abilities of middle and 
lower class children have been of considerable interest to researchers 
in recent years. Generally, the data have indicated that middle class 

children score well above lower class children on a ^ ^ fftlt 

individual and group measures of intelligence (Deutsch, I960). It h s 
also been noted that tasks requiring verbal comprehension and the 
ability to deal with abstract concepts are the ones which account in 
large part for the finding of such differences between classes (Carson 
and Rabin, 1960). Performance tasks which correlate highly with genera^, 
“wnigeice." Lch as the Goodenough Draw-A-Man I.Q. test have not yield- 
ed significant differences between the groups (Anastasi and D Angelo, 

1952) . 



Although the exact nature of the verbal skills which underlie tes 
taking ability is not yet clearly understood, a number of hypotheses 
have been offered to account for the social class differences. Prominent 
amonc these is the theory of social class and linguistic development offer- 
Z ly Bafu Bernstein (1961) . According to Bernstein la^uage s«uctures 
and Lnditions what and how a child learns, and thus how he performs on 
tests of intellectual functioning. He identifies two forms of comuni ca- 
tion codes or styles of verbal behavior: restricted and elaborated. 



Restricted codes are described as: "stereotyped, limited, and 

condensed, lacking in specificity and the exactness needed for precise 



^A version of this chapter was presented as a paper at the 1968 
annual meeting of the American Educational Research Association, by 
Sally A. Thomas j Samuel R. Schutz, and Evan R. Keislar, ent e, . 
"The^effect of different verbal directions upon the interpretation of 
conceptual rules by middle and lower class kindergarten children. 
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conceptualization and differentiation. Sentences are short, simple, 
often unfinished; there is little use of subordinate clauses for elaborating 
the content of the sentence; it is a language of implicit meaning. The 
basic quality of this mode is to limit the range and detail of the concepts 
and information involved" (Hess and Shipman, 1965) . 



Elaborated codes, on the other hand, are described as: "those in 

which communication is individualized and the message is specific to a 
particular situation, topic and person. It is more particular, more 
differentiated, and more precise. It permits expression of a wider and 
more complex range of thought, tending toward discrimination among cog- 
nitive and affective content" (Hess and Shipman, 1965). 



Restricted codes, according to Bernstein, are typically used by lower 
class families; whereas the elaborated code is the usual mode of commun- 
ication for middle and upper class families. The effects of early and 
consistent experience with these codes may then be seen to result in 
differential cognitive development and academic achievement and test 

performance. 



Some empirical support for Bernstein's position has been provided 
bv a series of studies carried out at the Urban Child Center of the 
University of Chicago (Hess and Shipman, 1966). The abjective of the 
research program was to relate the verbal behavior and performance of 
mothers from four different socioeconomic classes to the cognitive and 
scholastic behavior of their children. The data, which app^r to confirm 
Bernstein's hypotheses in regard to the effect of the socialization of 
differential linguistic codes, were obtained from interviews with the 
mothers and from the scoring of tests of the children's performances 
in three structured teaching situations. In summarizing their data, 
which are not as yet complete, Hess and Shipman have supested that the 
effect of the restricted code is to require the lower class child to 
respond only to commands and thus he is hot apt to reflect or to re ate 
his behavior to the context in which it occurred. The result of the soc a 
ization of the elaborated code, however, is to require the middle class 
child to reflect, to consider the consequences of his behavior, to weigh 
decisions, and to choose among alternatives. 



The findings of the Hess and Shipman studies indicate that children 
from lower socioeconomic class backgrounds enter school with a somew at 
different language system than do middle class children. These results 
are in accord with the findings of a large cross-sectional language study 
done at the Institute for Developmental Studies at the New York Medical 
College. According to Dr. Cynthia Deutsch (1966) these differences in 
language systems are particularly notable in the grammatical structure 
of the language, and in language used to express relations. In senera , 
the linguistic code of the disadvantaged or lower class child has been 
found to be "simpler in syntax and less rich in descriptive terns and 
modifiers" than that of the middle class child; and to be particularly 
deficient in the use of sentential connectives or function words U‘.e. 
and, not, either , or i^) . 



The language deficiencies of disadvantaged children then, may be 
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seen as consisting in the lack of ability to.deal with certain^ language 
structures which are necessary for obtaining and transmitting information 
and for carrying on verbal reasoning. In short, the disadvantaged child 
fails to master the cognitive uses of language which are the uses that 
are of primary importance for successful school performance. 



The reported findings of differential language patterns between social 
class groups would seem to be of critical importance in accounting for 
the consistent differences in performance of the two groups on various 
tests of intelligence. The relative facility of children in different 
socioeconomic class groups to understand and respond appropriately to 
different verbal directions would also seem to be relevant to this question. 
In most research reports and descriptions of test instruments, however, 
the directions to the subjects are briefly described or indirectly quoted 
or presented in the appendixes. Usually the forms of such directions 
or instructions are considered to constitute a set of background variables 
rather than independent variables entering into the experimental or testing 
questions (GagnI 1964). In contradistinction to such factors as the amount 
of stimulus material presented, the nature of the stimuli (whether 
figures, sounds, or objects) and the order of presentation of the stimuli, 
verbal directions tend to constitute a portion of the testing situation 
which is controlled rather than varied. Most often a standard set of 
directions, which has not necessarily been carefully pretested for ambiguity 
or clarity of linguistic content, is given to all subjects in the same 
way that a standard amount of illumination is used in the testing room 
or a standard volume fdr'the tape' recorder is selected. 



It is possible, however, to consider the verbal direction to the 
subjects as comprising a set of important independent variables worthy 
of experimental manipulation and investigation. Differential acquisition 
rates for a number of learning tasks such as problem solving (Maier , 1930) , 
concept learning (Gagni, 1964) and classical eyelid conditioning (Norris 
and Grant, 1948) have been reported to be a function of the particular 
verbal directions given. In some cases the use of different directions 
for the same task resulted in more rapid learning of motor skills (Gagne, 
1964). In one study the absence of verbal instructions in a relatively 
simple concept learning problem resulted in an almost 

for those who did not receive verbal instruction. As Gagni (1964) has 
pointed out, "Instructions do not operate as undifferentiated voca 
noises. Instead what is said (or not said) is quite important to the 
results obtained." The nature of the relationship between the conceptual 
learning and the verbal directions which are a part of the learning tas , 
is a complex problem for researchers concerned with conceptual behavior 

in humans (Bourne, 1966). 



Differences in the effect of verbal directions, which have been 
obtained in the previously cited studies, would appear to be re ate to 
whether the subject "understands" the directions which are used to describe 
the task or to call for a particular response. That is, whether “ot 
the child can respond to the directions appropriately depends upon his 
prior ability to deal with the grammatical constructs and sentential con- 
nectives involved in the instructions. Relating the findings of differ- 
ential language patterns between middle and lower class children to 
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the question of the effect of different verbal directions upon conceptual 
problem solving behaviors would thus appear to be of considerable research 
importance. 

Problem 



The purpose of the present study was to assess the abilities of middle 
and lower class kindergarten children to respond appropriately to different 
concept defining rules as a function or the manner in which the directions 
were phrased. It was proposed that differences in children’s abilities to 
understand and respond appropriately to verbal directions are related to 
differences in socioeconimic status and are based upon differential language 
patterns. Whether or not children are capable of responding appropriately 
to directions in a conceptual problem solving task was hypothesized to 
depend upon their prior abilities to deal with particular terms involved 
in the instructions, as well as their abilities to deal with various sentence 
formats (interrogative, imperative, declarative and incomplete sentences 
involving key-word phrases) ♦ 

Subjects 

A total of 60 kindergarten children from the greater Los Angeles 
area served as subjects} 29 from a middle socioeconomic class, predomi- 
nantly Caucasian school; and 31 from a lower socioeconomic class, pre- 
dominantly Negro school. The ages of the subjects ranged from 5.0 years 
to 5.8 years. 

Test Instrument 



The test instrument was developed after several preliminary tryouts 
with 64 children. In its final form, it provided a measure on five 
concept rules (affirmation, negation, conjunction, disjunction and joint 
denial) when the directions were given in four different sentence formats 
(key words — incomplete sentences, declarative, interrogative and impera- 
tive sentences). There were 100 items in the entire test. 

For half of the test, designated as the "Following Instructions" 
portion, the children were presented with a series of 50 6" x 8" white 
stimulus cards, each containing two pictures. For each item, the subjects 
were given a tape recorded direction designating the correct conceptual 
rule. They were required to point to the picture which matched the rule. 

The other half of the test, designated as the "Problem Solving" 
portion, consisted of a series of ten retention problems (two problems 
for each conceptual rule). Each problem had five different 6" x 8" 
stimulus card items, but the tape recorded direction designating the 
correct concept rule was given only on the first item. The subjects 
were then required to remember the correct concept defining rule in order 
to respond appropriately to the four subsequent items on which no directions 
were given. The subjects were required to point to the picture which 
matched the rule given on the first item. 

To illustrate the way in which the sentence formats were related 
to the concept defining r’.iles and to the pictorial sitmuli, examples of 
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affirmation and negation problems are presented in Figures 3 and 4. 

In addition, sample items for conjunction, disjunction and 'joint denial 
problems may be found in Appendixes I and 2. 

Procedure 

Following an introduction to the task, a practice session was given 
to teach all subjects to give an appropriate pointing response for each 
item. This practice was repeated until each child reached a criterion 
of 10 errorless trials in pointing to the right picture. The test was 
administered to each child individually on four successive days. Each 
daily test session was approximately 15 minutes in length. The order 
of presentation of concept defining rules and sentence formats was 
balanced across subjects for both the Following Instructions and the 
Problem Solving portions of the test. 

Results 

The performance of subjects on Part I, Following Instructions, of 
the test was very similar to their performance on Part II, Problem Solving, 
no reliable differences were found on any comparison for either social 
class between the two parts. Consequently, in order to simplify the 
analysis and to provide greater reliability, the scores from corresponding 
sections of the two parts were combined. 

The results of the general test are presented in Table 4. Here are 
given the mean errors and standard deviations for each sentence format 
and concept defining rule combination for the two social classes separately. 
In addition total scores for each rule are given for each social class. 

From Table 4 it may be noted that the rule of affirmation was quite easy 
for both social class groups. Disjunction and conjunction were of inter- 
mediate difficulty and negation was much more difficult. The problems 
involving joint denial, however, were so extremely difficult for all 
subjects that the mean scores for this rule were at a chance level; 
consequently, in the analysis of the data, scores for this part of the 
test were excluded. 

The data were analyzed using a Latin Squares (repeated measures) 
design with a correction for unequal N*s. The results of the analysis 
comparing four concept rules, four sentence formats and two socioeconomic 
classes are given in Table 5 and may be summarized as follows; 

1. For the total test, the difference in performance of middle and 
lower class children was not reliable. 

2. Performance on the concept defining rules differed significantly 
with the affirmation items by far the easiest and the joint 
denial items the most difficult for all subjects. The ascending 
order of difficulty for the five concept rules was affirmation, 
disjunction, conjunction, negation and joint denial. 

3. There was a significant difference attributable to the sentence 
format of the directions. Some formats were much easier for the 
children than others. 
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Figure 3. Sample Item for the Rule of Affirmation for Each Sentence Format 
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Figure 4. Sample Item for the Rule of Negation 
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TABLE 5 

Results of the Latin Squares Analysis by 
Social Class, Concept Defining Rules, and Sentence Format 




4. The interaction between social class and sentence format was 
significant at the .05 level. These figures in mean errors and 
standard deviations, for lower and middle class subjects on four 
sentence formats, have been presented in Table 6 for comparison 
purposes and are represented in graphic form in Figure 5. As 

it may be noted from the figure, the differences took the follow- 
ing form. 

(a) Middle class kindergartners did relatively better when 
the sentence format was interrogative; for example; 

"Which box has no apple?" The poorest performance for the 
middle .class kindergartners; however, was obtained when 
the directions were given in the short key word phrase 
incomplete sentence format as; "no apple." 

(b) Lower class kindergartners on the other hand did relatively 
better when the directions were given in the short imperative 
sentence format as; "Find no soldier." The poorest per- 
formance for the lower class subjects was obtained when 

the directions were in the complex declarative format; 

"In the right box, there’s no dog." 

5. Since a significant interaction was obtained between social class 
and sentence format, an analysis of the simple effects was carried 
out. The analysis revealed that for middle class subjects the 
sentence format of the directions was .significant at the .01 
level. The effects of differences in'isentence format for the 
lower class kindergartners were not reliable. 

Conclusions 



The data obtained from the present investigation support the hypothesis 
that a comparative analysis of middle and lower class children’s verbal and 
conceptual abilities must take into account the subjects’ differential 
facilities in understanding and interpreting directions. The observation 
that the ability to follow directions correctly varies according to the 
specific sentence format used, and that sentence format is particularly 
important for middle class children is also of interest. 



One interpretation of this finding is that perhaps some of the differ^ 
ences which have been obtained between social class groups may be due to 
selection factors in test constructions which favor by inclusion, the par- 
ticular language patterns most familiar to middle class children. This 
interpretation is based upon related research which has indicated that 
longer, more complex sentences such as were employed in the interrogative 
and declarative sentence formats of the test, are much closer to the patterns 
of verbal directions and communication which are typical to the middle 
class culture (Deutsch, 1966; Bernstein, 1961). 



Additional related research has indicated that lower class children , 
to whom the use of function words is little known, are not aided by their 
inclusion in full sentences. But for these children, performance is as 
good or better when the directions are given in key words , incomplete 
sentences and very simple sentences such as were employed for the key word 
and imperative sentence formats of this test (Hess and Shipman, 1966) . 
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Chapter 4 



KINDERGARTEN CHILDREN'S USE OF 



VOCAL LABELING RESPONSES IN PROBLEM SOLVING 



Problem 



, This investigation assessed the relative value of instructing kinder- 
garten children to speak out loud functional attribute labels or non- 
functional object labels during a problem solving task involving selective 
learning, in comparison with children not instructed to label. When chil- 
dren respond to their own language, it would be predicted that functional 
verbal cues would serve to facilitate performance whereas non-functional 
cues would Interfere. 



Of parallel interest is the question as to whether the value of such 
oral responding with attribute labels is greater for those problems where 
the verbal labels are less available in the child's active vocabulary. 

The effect of oral practice should be greater with these labels than with 
labels already high in the child's verbal repertoire. 



Hypotheses 



1. On a selective learning task requiring the subject to identify 
one of three pictured objects differing only in size, young children in- 
structed to speak aloud critical attribute labels (e.g., bijg) to each stim- 
ulus as it is chosen during training will perform better than (a) children 
who are not instructed to label and (b) children who are instructed to 
vocalize the common object labels (e.g., dog). This superiority will be 
manifested on the following three criteria: (1) Performance during train- 

ing; (2) Performance on a posttest involving the same dimensions as those 
presented in training; and (3) Performance on a transfer test involving 
a stimulus dimension not Included in training. 



2. All children will perform better on those problems where the ex- 
treme stimulus (e.g., large or small) is the correct picture than on the 
problems where the intermediate stimulus is correct. 



3. The superiority in performance predicted for children receiving 
attribute labeling training will be greater for those problems where the 
medium-sized stimulus is correct than for problems having the large or 
small stimulus as the correct picture. In other words, there will be an 
interaction effect between type of item and treatment condition. 



^A version of this chapter was accepted on the program of the 1969 
meeting of the American Educational Research Association to be presented 
as a paper entitled, "Kindergarten Children's Use of Vocal Labeling 
Responses," by Robert H. McNeany and Evan R. Keislar. 
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Method 



Subjects 

The study was carried out with 42 f ive-year-old predominantly lower 
socioeconomic Negro children in a Los Angeles Elementary School. The ages 
ranged from 61 to 69 months with a mean age of 65 months. The mean mental 
ag^ based on the Peabody Picture Vocabulary Test, was 61 months. 

Task and Materials 



Each child was shown a sequence of 35mm. color slides, projected on a 
6" X 8" rear view projection screen by an Argus Slide Projector. Each 
slide consisted of three pictures of the same object, alike in all respects 
except that they differed in either size, thickness, or length. For ex- 
ample, on one slide might appear a large cow, a medium-sized cowi^ and a 
small cow. Sample slides v;hich were presented during training and on the 
post test are shown in Figures 6, 7, and 8. 

The child was presented with a series of problems on each of which he 
was required to point to the picture which was the correct size. A prob- 
lem involved four slides. Each slide within a single problem showdd the 
same object in three different sizes. For each problem, the three pictures 
were randomly positioned on each slide, with the same sized picture correct 
on all four slides. 

Problems differed with respect to the subject of the stimulus pictures 
(e.g., monkeys, clowns, etc.) as well as the dimensions along which the 
pictures differed (i.e., size, thickness, or length). For each problem, a 
new set of stimulus pictures was used. The size of the correct stimulus 
for each problem was randomly determined. For example, on all four slides 
of Problem 3, the medium drum was the correct picture; on Problem 4, it was 
the little dog. 

The first slide of each problem informed the child what the correct 
picture was for that problem. He was then shown a second slide containing 
the same pictures in a different arrangement. The child was instructed to 
"Find the same one." JE provided immediate knowledge of results for all 
groups by saying "That’s right" when the child pointed to the correct pic- 
ture. If a subject chose the wrong picture, he was told, "No, try again." 
Thus, each child always selected the correct picture before JE presented the 
next slide. 

Design 

The 42 kindergarten children were randomly divided into an Attribute 
Labeling Group, a Non-labeling Group, and an Object Labeling Group, each 
containing 14 subjects. For purposes of analysis, each of the three treat- 
ment groups was divided into two levels of mental age with each sub-group 
containing seven subjects. All groups received the identical visual pro- 
gram, with the difference in treatments being entirely in terms of the 
verbal commentary. 
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Figure 6. Sample Slide for Size Dimension Presented During 
Training and On the Post test 




Figure 7. Sample Slide for Thickness Dimension Presented During 
Training and On the Posttest 
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Figure 8. Sample Slide for Length Dimension Presented During 
Training and On the Post test 
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The Attribute Labeling Grpup was instructed to respond by saying 
aloud the relevant attribute label big , medium , or little for a given 
stimulus immediately before pointing to that stimulus. It was judged 
necessary to use the same set of labels big , medium , and little for 
stimulus pictures which varied along the different but related dimen- 
sions of size, thickness, and length. This decision was based upon an 
investigation, reported earlier, with a similar learning task (McNeany 
and Keislar, 1966), where children in the Labeling Group were required 
to learn four sets of attribute labels. In the previous study, it was 
concluded that "...where a variety of similar labels are used, this very 
act of speaking may be non-facilitating or even interfering." (P. A2) 

The Non-labeling Group was given no instruction to speak aloud; they 
responded to the same questions silently by pointing. The Object Label- 
ing Group was instructed to say aloud the name of the object shown in the 
three different sizes on each slide (e.g,, dog, Indian, etc.) before 
pointing to the correct picture. The labels this group vocalized for each 
problem were appropriate for the pictures but served no function since 
they were unrelated to the rule used for the solution. 

In order to compare the results for those problems where the medium- 
sized stimulus was correct with problems where either the large or small 
stimulus was correct (Hypothesis 2) , half of the problem^; had the medium- 
sized picture as correct; for the remaining problems, V.he correct picture 
was either the large or the small object. 

Procedure 



The total experiment required five davs. Each day*s session lasted 
from lA to 17 minutes. The program was almlnistered individually to each 
child by one of two experimenters. For h M.f of the children in each 'of the 
three treatment groups, the program was administered by one for the 
remaining subjects the program was given by the other The experiment 
consisted of three phases s pretraining and familiarization, experimental 
training, and testing. These three phases are described below. 

Pretraining and Familiarization 

The child was brought into the experimental room and seated at a small 
table across from The pretraining program was identical for all subjects 
and lasted for approximately seven minutes. Its purpose was to instruct all 
children in the use of the attribute labels, big , medium , and little * so 
that differences in performance among the three treatment groups during the 
instructional program would not be attributed to differences in availability 
of the functional attribute labels. 

The children were shown three different sized boy barrels. JE held up 
the large barrel and said "Each of these barrels has a name. The name of 
this barrel is big ." JE repeated this procedure with the medium and little 
barrels. The child was then required to supply names for the different 
sized barrels as ^ held them up. This was repeated to a criterion of six 
correct labels in a row. 
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After this pretraining, all subjects were presented with an eight 
minute program designed to familiarize the children with the instruc- 
tional materials. Each child was seated before the rear view projection 
screen described above and shown a series of eight slides, each of which 
was divided into three squares. The initial slide showed a kite, a cat, 
and a ball. The child was told, "Look at the screen in front of you. 

See the three boxes. There is a cat in one of the boxes. Point to the 
cat." The remaining seven frames were similar to the first frame. At 
the end of the familiarization program, subjects were randomly assigned 
to the Attribute Labeling Group, the Non— labeling Group, or the Object 
Labeling Group. 



Experimental Training 

On the first day of instruction, all children were presented with 
a training program consisting of fifteen problems described above. The 
first slide of each problem consisted of three pictures which were ali^vB 
in all respects except that one was large, the second was medium-sized, 
and the third was small. Above one of the different sized pictures was 
an arrow. 

The instructions for the Non-labeling Group were "Look at the arrow. 

The arrow points to the right picture. Remember which picture is right. 

It will be right next time too! Now point to it." The child was then 
shown a slide identical to the first except that the stimuli were in 
different positions and there was no arrow. Each child was instructed to 

"Find the same one. Point to the same picture." The third and fourth 

frames of each problem were identical to the second except for the 
rearrangement of the pictures. The child was then presented with another 
problem which differed from the first with respect to the subject of the 
stimulus picture as well as in the size designated as correct. 

In addition to the above, children in the Attribute Labeling Group 
responded by saying the attribute label big , medium, or little aloud as 
they pointed to their choice. 

Children in the Object Labeling Group, besides performing the task 
required of subjects in the Non-labeling Group, responded by saying aloud 
the name of the object class to which each of the three pictures on a 
slide belonged (e.g. cow, monkey, etc.) as they pointed to their choice. 

If a subject in the Attribute Labeling Group or the Object Labeling 
Group failed to vocalize the correct label, E said "What is its name?" 
All three treatment groups responded by pointing and received immediate 
knowledge of results on e^ch frame. 

The training program presented on the second day of instruction 
was similar to that of the first day except for the dimensions along 
which the pictures differed. For problems 1—10 on the first day, 
pictures differed in size; for problems 11-15, the difference was in 
thickness. On the second day of instruction, problems 16-20 differed 
in thickness while problems 21—30 differed in length. (See Appendix 3.) 




mBM 



tei i ija iW! 









... 



'i 

k 

j 







32 



Criterion Tests 



To test the hypotheses of the study, three dependent variables were 
used: (1) Performance during training; (2) A posttest; (3) A transfer 

test. The training scores reflect the total number of correct responses 
made during the instructional program. (Sf^e Appendix 4.) 

The posttest, given on the day following the instructional training, 
consisted of 12 problems, using the same three concepts on which the 
children had been trained but with different subjects for the stimulus 
pictures. The number of frames involved in each problem was increased to 
five. 



On the day following the posttest, subjects were presented with a 
transfer test consisting of 12 problems. The task required of each child 
on this transfer test was similar to the task required during training, but 
the stimulus pictures were varied in color value, a dimension on which the 
children had not received training. On each of the 12 problems there were 
five frames. 

For the post test and transfer test, all subjects received the same 
instructions; no child was asked to speak or provided with assistance in 
speaking. 

Since the first frame of each problem on the tests was also used as 
an information frame, the child’s performance on these initial frames was 
not included in his score. The highest possible score on the 30 training 
problems was 90 points, three points for each problem. A perfect score on 
either the posttest or the transfer test was 48 points, four points for 
each problem. 

Results 



For each of the three criterion measures (training, posttest, and 
transfer test), a 2 X |3 X 2 analysis of variance with two levels of mental 
age, three treatment conditions, and two item types was conducted using 
a repeated measures design. The analysis of variance presented in 
Table 7 shows significant differences among the three treatment groups 
both during training (p<o01) and on the posttest (p<.05) involving 
similar but new problems. Table 8 shows the mean number of correct re- 
sponses for the three groups for each item type on each of the three 
criterion measures. These have not been presented by mental age since 
this was not foupd to be a significant variable either for main effects 
or for interactions - 

The Newman-Keuls technique of multiple comparisons was used to test 
the differences in treatment means. The Attribute Labeling Group was 
superior to the Object Labeling Group during training (p<.01) and on 
the posttest (p<,01), but was significantly superior to the Non-labeling 
Group only during training (p ^.01). 

The results of the transfer test, also presented in Table 7, shows 
the mean number of correct responses for the three groups. An analysis 
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TABLE 7 

Means and Standard Deviations of Training, Posttest, 



and 


Transfer Test 
(Based on 


Scores on Two Types of 
14 subjects per group) 


; Items 


] 


Treatment 

Groups 


Type of Item 
as Correct Resnonse 
Medium Blg-Llttle 

M SD M SD 


J 

Total i 

"t 

M SD • j 




Training 












i 

! 


Attribute Labeling 


32.7 


5.3 


39.5 


3.1 


72.2 


7.7 ] 


Non-labeling 


30.4 


5.1 


34.7 


5.6 


65.1 


11.2 


Object Labeling 


26.4 


4.0 


34.3 


6.6 


60.7 


8.4 1 


Total 


29.8 


8.6 


36.2 


4.9 




V 

■t' 

i 


Posttest 












$ 


Attribute Labeling 


18.5 


2.7 


21.1 


2.4 


39.6 


3.7 


Non-labeling 


17.0 


2.7 


20.2 


2.7 


37.2 


5.3 . ^ 


Object Labeling 


15.8 


3.7 


18.9 


2.8 


34.6 


5,2 S 


Total 


17.1 


3.5 


20.1 


2.7 




1 

• 1 


Transfer Test 














Attribute Labeling 


V ,3 


3.9 


18.1 


3.2 


33.9 


6.4 ^ 


Non-labeling 


14.8 


3.9 


18.9 


3.0 


33.8 


5.8 i 


Object Labeling 


14.5 


4.1 


18.1 


2.2 


32.6 


5.7 j 

'i 


Total 


15.1 


3.9 


18.4 


2.8 
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of variance on these transfer test data (see Table 8) provides no support 
for the hypothesis that those children given training in vocalizing 
attribute labels would perform better on a transfer test. 

Turning now to the differences in item type, the analysis of variance 
shown in Table 8 indicates there was a significant main effect for this 
factor. On the training posttest and transfer tests, there were a sig- 
nificantly greater number of correct responses for those items where either 
big or little was the correct size, than when the intermediate stimulus 
was correct (p<.01). The means and standard deviations for all subjects 

on the two types of items are shown in Table 7 . 

> 

Hypothesis 3 was not supported since, as Table 8 indicates, no 
interactions were found to be significant on any of the criterion measures. 

Conclusions 



This study demonstrated that in a two-day training period involving a 
different but related set of training materials, a child’s performance on 
a problem solving task involving selective learning is facilitated by 
training in using appropriate labels. All problems involved a consistent 
set of labels (i.e. big , medium , and little) . The children given training 
in overt verbalization of these labels over this two-day period performed 
significantly better during training than children who saw the same stimuli 
but who either were not given labeling training or were taught to label 
the object (e.g. cow, Indian, etc.). The finding that the Attribute 
Labeling Group performed better during training cannot be ascribed to the 
fact that the children in the other two groups did not have the labels as 
easily available; all subjects were given pretraining in order to provide 
assurance that all children could easily say the three labels to the 
appropriate stimulus. 

On the posttest, involving the same dimensions as those on which 
the children had received training, children in the Attribute Labeling 
Group continued to perform significantly better than children in the 
group receiving Object Labeling training but did not perform reliably 
better than the Non-labeling Group. On this test, all children were 
"on their own," that is, they received no instructions or assistance 
in labeling. 

The superiority of the Attribute Labeling Group cannot be attributed 
simply to overt verbalization since a spoken response was required of 
the Object Labeling Gropp as well. The necessity of verbalizing the 
relevant labels correctly during training may have forced the child in 
the Attribute Labeling Group to pay attention to the critical features 
of the problem. Since the Object Labeling Group performed significantly 
worse than the Non-labeling Group during training, it is likely that the 
production of non- functional labels blocked in some way a child’s 
ability to identify and choose the correct stimulus. 

The fact that the superiority of the Attribute Labeling Group over 
the Non-labeling Group on the posttest was not reliable deserves comment. 

The total training time was not long, a total of approximately one-half hour* 
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Chapter 5 



ORAL AND NON-ORAL METHODS OF TEACHING READING: 



A REPLICATION^ 



Introduction 

The present experiment Is e replication of an Mrller study by McNeil 
and Kelslar (1963) in which oral and non-oral methods of teaching reading 
were Investigated, utilizing an auto-instructional 

design, the procedures are similar to the earlier study but the conditions 
and materials are more akin to current classroom Instruction! some changes 
were necessary in the transition from a mechanical instrument for instruc- 
tlon to conventional schoolroom materials. 

It was the purpose of the present study to determine whether °’^al 
responding during instrpction in reading, in contrast to ' 

out overt speech, facilitates siient reading as measured by recognition an 
understanding of written words and sentences. 

on at the kindergarten level, under closely controlled conditions wi 
plicable procedures and materials, 



Bpv iew of the Literature 

Studies, reports and theories related to teaching reading t<> « 
children have led to conflicting opinions regarding the value of the oral 
mert^ in the teaching of readlSg.'^ The point of view ‘“at saying words 

aloud is detrimental to learning to read no47? h^L 

American education. For example, McDade (193*) and Buswell (194p ^ve 

stated that oral responding interferes with learning, g“ j®‘ 

ginning reading. They performed a number of experiments , 

young children contraLlng non-oral and oral ^thods of ® 

reading and concluded that the non-oral method was superior to the oral 

method. 

More recent research, however, has ralped the "^®®5®f 

vocalization might be an aid to the reader, especially where the material 
is unfamiliar o? difficult. Edfelt (1960) found that silent 
sured by actual muscle movements by means of an ®l®®‘’^“y°®“P*'* ^ M 

^en the reading material became difficult. He suggested that lip 
t“ng reading were not the cause of inefficient performance but an indica- 
tion that the reader did not find the material easy io read. 



^This chapter has appeared as, "Oral and »®“-P“V®S^Slii°^n®Educ2 
Reading: A Replication," by Evan R. Keislar and John D. McNeil, in Educe 

T.aadershio Resea rch Supplement. May 1968, P, 761-764. 
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In their original study, McNeil and Keislar (1963) found the oral 
method, i.e., speaking the words aloud while learning, to be superior 
to the silent learning program even though the criterion consisted of 
a silent reading test. Myresko (1966) also has referred to cases where 
oral reading improved a pupils 's silent reading skills. 

However, Sheldon and Lashinger (1966) reported no differences in 
achievement when they compared three methods of teaching reading, one of 
which emphasized vocalization. Rosenljaum (1962) found that while peer 
and expert (the experimenter) verbalization facilitated recognition, self- 
verbalization in a chorus of four did not. Vocalizing in chorus appeared 
to interfere with the effect of self-verbalization. 

The hypothesis of the present study is in part based on the mediation 
theory advanced by Kendler and others that young children at the age of 
four and five are beginning to use verbal responses as self-cues. Where 
language is overtly expressed, the responses are more likely to be learned 
and, therefore, to function subsequently in a cpvert self-cueing role. The 
theory rests in part on evidence that kindergarten children who labelled 
overtly showed superior inferential behavior compared with those who did not 
label. (1966) . 

If a child says aloud words and sentences as he is learning to read, 
he will be better able subsequently to understand these words in new sen- 
tences even though he need not continue to say them aloud. These "silent" 
verbal responses act as mediating or self-cueing responses to lead the child 
to recognize the correct meaning of the printed words. 

Hypothesis 

Participating in the study were 127 five-jgnd six-year-old children from 
two schools in Los Angeles representing two social classes* upper middle and 
upper lower. However, thirty children were not included in the final analy- 
sis because of three or more absences during training. < Five additional 
children were not included because their high scores on the pretest indicated 
that they could already read most of the words to be taught. The final ex- 
periment consisted of 92 children, 46 of whom were assigned at random to the 
oral group and 46 to the non-oral group. 

Instructional Materials and Procedures 

The instructional program consisted of eight daily lessons administered 
by tape recording over a two-week period. The materials, except for instruc- 
tions regarding speaking aloud, were identical for the oral and non-oral 
groups. The instructional goals for both experimental groups were the same, 
namely, to have each child acquire a basic reading vocabulary of twenty words, 
derived from lists of the most frequently used vocabulary. Each lesson was 
Incorporated into a booklet of approximately forty-eight items or frames, one 
per page. The pages of the booklets were in various colors so that it could 
be seen at a glance that children were on the right page in accordance with 
the taped ' commentary . (See Table 9 for sample items.) 
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TABLE 9 

Sample Items for Reading Instruction 



1. Matching to Sample 



children 



run 



fast 



children 



2, Word Identification from Commentary 




3, Matching Pictures to Printed Words 



The baby Is crying. 



(Picture of 
dpg) 



(Picture of 
mother) 



(Picture of 
baby) 



4. Matching Printed Words to Pictures 



(Picture of 


children and cats running) 


Children and 


cats 




run fast. 


Mommy was 






crying. 


Billy saw the 






bgby. 
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Commentary 



Mark the bottom word 
that Is just the same 
as the top word. 



Commentary 

Mark the word cats. 



Commentary 



Read the top word. Mark 
the picture that goes 
with the word. 



Commentary 



Mark the words that go 
with the picture. 



















All Items Involved either two or three choices with circles below 
each choice for marking the correct response. The children were supplied 
with water-filled felt-tip pens to mark their answers, and paper In the 
booklets was specially treated so that the circle denoting the correct 
answer turned green when marked with the water pen and all other circles 
turned red. 

The variety of tasks to be performed Included: matching a*:cue word 

at the top of the page to one of three words at the bottom, finding a 
printed word from an oral cue with no written cue, matching a picture to 
the proper word and sequence of printed words, and completing missing 
word sentences by Indicating which word of three would best complete the 
sentence. While all subjects were required to make a choice on each Item, 
only the children In the oral group were Instructed to say the stimulus 
word or the correct answer aloud. 

In each of the two schools children were Instructed In groups of ten 
to fifteen, two oral and two non-oral groups per school. Lessons were 
presented to each group In succession In twelve to fifteen minute dally 
sessions. The functions of the three monitors present during the lessons 
were restricted to keeping order and seeing that everyone was on the proper 
page. 

Pretest and Posttest 



The pretest was used to Indicate the extent to which children already 
could read the words in the program. On the first day, the children were 
Initially given an orientation program in which they learned the lesson 
procedure Including how to respond by marking. The rest of the first day's 
session involved the pretest which was designed to assess the children's 
knowledge of reading as demonstrated by their ability to identify pictures 
and to read words. 

The posttest (see Appendix 3 ) , administered on the tenth day of the 
experiment, consisted of 50 Items pertaining to the twenty-word reading 
vocabulary which was the objective of the teaching program. Reading know- 
ledge of each word was tested In several ways: matching to sample, sentence 

completion tasks, and Identifying words and sentences from oral cues and 
picture cues. The criterion,, therefore, dealt with the ability to under- 
stand the printed material as well as to recognize the differences between 
printed words and to identify the printed form of the spoken word. 

Results 



In Table 10 are shown the mean number of correct Items on the pretest 
and the posttest along with the respective standard deviations for the ex- 
perimental and control groups. These data show that the two groups did not 
differ in their Initial ability to perform on the reading task. A Jt test 
was used to compare the differences between the oral and non-oral groups. 
The difference, significant at the .05 level, indicates that children in 
the oral group achieved more success In beginning reading than children 
who were not given opportunity to vocalize while learning to read. 
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TABLE ID 



Pre- and Posttest Scores for Oral and Non-oral Groups 



Groups 



Pretest 
Mean S.D. 



Posttest 
Mean S.D. 



Oral 

(N=46) 



6.4 



2.2 



29.4 



8.7 



Non-oral 

(N=46) 



6.3 1.7 

t=.33 



26.1 8.6 
t»2.06* 



* p^.05 




Discussion 

Support has been shown for the hypothesis that the oral method of 
teaching beginning reading Is significantly superior to the non-oral 
method. This Is so, at least. In the Initial stages of learning to read 
where the criterion Is recognition and comprehension of the printed word 
rather than speed reading. In this study, the oral method of teaching 
reading was defined as'"one in which the child was required to say printed 
words aloud as he selected a choice on each Item. In the non-oral method, 
children were simply instructed to choose an alternative for every item 
without responding orally; as they read silently, they Indicated thel^r 
comprehension only through the selection of their choices. 

Even though the criterion test required only silent; reading, the oral 
group performed significantly better. It is noteworthy that proficiency 
in silent reading can occur from an instructional procedure that demands 
vocalization. The findings are consistent with the mediation theory that 
if young children are given instructions to respond overtly, they subse- 
quently will be able to produce this response as a covert self-cue to 
bring about appropriate behavior. The replication study has demonstrated 
the value of the oral response under modified conditions indicating that 
the original conclusions are generalizable. 
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Chapter 6 



TRAINING IN LISTENING TO AND 



APPLYING CONCEPT-DEFINING RULES ^ 



Introduction 



The major purpose of this exploratory study was to discover ways in 
which kindergarten children might be taught to listen to a rule presented 
by a teacher and then to apply this rule to a succession of events. The 
kind of rules involved in this study were those which define concepts. 

The application of the rule consisted of identifying positive and negative 
examples of the concepts. Since most concepts in school are learned in 
this deductive fashion, the ability to listen to and apply concept-defining 
rules is a valuable learning outcome for a child starting school. Actually 
saying the rule aloud to provide self-cues might be an important way in 
which this instruction could be assisted. Therefore, a primary question 
for this investigation was to determine whether rule-learning is facili- 
tated by requiring the pupil to speak the rule aloud as he applies it in 
a succession of items. 

The task used in this study possesses a number of features: 

1. The task involves deductive rather than inductive learning. 

2. It requires rule utilization and not rule verification. 

3. The four rules selected are the conceptual types found 
earlier in this project to be appropriate for this population. 

4. From the viewpoint of languge learning, the task requires an 
understanding and use of certain function words. 

5. In an effort to approximate conditions within a classroom, 
both rule and instances were presented at a level of complex- 
ity or "noise" considerably above that used in laboratory 
experiments . 

The study was carried out in two stages. The initial goal was to de- 
velop an effective instructional program for teaching children to apply 
new concept-defining rules. This oral program was evaluated by comparing 
the performance of an instructed group of children with that of an unin- 
structed group. Subsequently, a non-oral version of this program was pre- 
pared and tried out with another sample of children from the same population. 
The performance of these children was compared with that of the children in 
the oral group as welT as the uninstructed control. 



^A version of this chapter was accepted on the program of the 1969 
meeting of the American Educational Research Association to be presented 
as a paper entitled, "Teaching Kindergarten Children to Apply Concept- 
Defining Rules," by Evan R. Keislar and Samuel R. Schutz. 










Deductive versus Inductive Concept Learning 
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inductive, one is given the last two parts; when the 
problem is deductive, the first two parts are given. 

The child who understands logical reasoning under- 
stands this argument form , whether the specific prob- 
lem is one of filling in the first or the last part. 

Typical inductive training proceeds according to the 
seemingly tenuous assumption that ; the child wlll:some- 
how learn this '’arguifient form -from' experiences that • 
never bring the various parte together in any cohesive 
manner, or never tie in with deductions and inductions 
with which he is familiar. (P. 55) 

Englemann goes on to indicate that learning to apply rules is highly 
important for the young child. 

The most important kind of induction the young 
child can learn is that rules that are given to him in 
the classroom apply to various instances. If the rule 
involves adding one to a number, he should learn that 
the rule holds for any situation, he chooses to test. 

The inductive test of effective rules is where primary 
emphasis should be directed, because this emphasis 
familiarizes the child with the basic argument form 
of logical reasoning, and it demonstrates the value of 
rules . To learn a rule is to learn a shorthand solu- 
tion to a range of problems. The child who learns to 
use the rules in this way also learns important skills 
connected with following instructions. (P.,55) 

I 

Th(:i deductive aspects of this task may be an important prerequisite 
to the handling of inductive type problems. In the current investigation 
this possibility was explored by including inductive concept identification 
problems as one of the final criteria. 

Ihile Verification and Rule Application 

An important component of inductive concept learning is simply that 
of verifyiijg the rule, that is, of testing a hypothesis. Two investigators 
have carried out studies in this field. Wason (1959), using concept-defining 
statements along with positive instances of the concept, asked the subjects 
whether or riot the rule defined the concept as represented by a specific ex- 
emplar. In other words, subjects were asked to verify the rule. In soL^ 
cases the instance presented was positive, in others it was not. Some of 
the statements vrere worded affirmatively, others negatively. Vason found 
that false negatives took much longer to verify than true affirmatives. 

Trabasso (1967) read the concept definition to the subject and then 
presented an instance. The time taken to verify whether the rule was true 
or false was recorded. Trabasso found that the addition of negation greatly 
increased the time required for both conjunctive and disjunctive types of 

rules. Again it was much easier to confirm the positive than to disconfirm 
a false negative. 
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In the present investigation, the emphasis was placed not on verifying 
but upon applying rules. The differences are indicated in Table 11, where 
it will be noted that these two approaches present the subject with quite 
different tasks. In the case of rule verification, the subject is asked to 
test the validity of the rule, assuming that the Instance given is Indeed 
a positive representation of the concept. In the case of rule application, 
however, the task is to determine whether the instance is positive or nega- 
tive, on the assumption that the rule is truly valid. Referring to the table, 
it can be seen that the information as to whether the judgment of the subject 
is correct or not leads to quite different actions. Of particular importance 
is the source o^^* the rule. If the individual proposes the rule to himself,' 
verification can be equated with hypothesis testing. On the other hand, if 
the experimenter presents the. rule* to the subject for verification, it is 
similar to the studies of Wason and Trabasso on rule verification. Rule 
application occurs in inductive learning of concepts after the individual 
has received some assurance that the rule is indeed applicable. Where the 
experimenter .or the teacher supplies the rule, evidence that the student truly 

understands the concept is provided when the rule is appropriately used. 

■ • 

Bourne has pointed out (1966) that there are two components in rule 
utilization: the rule Itself and the attributes. In concept identification 

problems it is presumed that the attributes have already been experienced, 
that is, learned. The individual is able to make discriminations among the 
values of a dimension and may also be able to label them. When he is asked 
to identify the concept, he makes use of this prior learning of the attributes 
so as to classify or sort on this basis. The task of the typical concept iden- 
tification problem is jfco determine which attributes are relevant and which are 
irrelevant. A more basic task in these problems is learning the type of con- 
ceptual rule involved in the particular concept. Haygood and Bourne (1965) 
showdd that subjects who were told which attributes were relevant but not the 
rule did better than subjects who were told the rule but not the relevant at- 
tributes. Subjects who were given neither of these components made more errors 
than those who had either one or the other. 
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King (1966) working with adults as well as children. 6, 9, and 12 years 
of age, told his subjects which attributes were relevant. The inductive con- I 

cept Identification task was to identify whether the rule being used was con- 
junctive or disjunctive. He found that at every age level the disjunctive 
rule was more difficult than the conjunctive. King found that his subjects, 
especially the six-year-olds, frequently solved the problems but without being i 

able to state the rule. Three stages in rule learning were suggested by his 
study. "In the first, children are not able to discover the rule nor to profit 
from verbal tutoring; in the second, they are not able to discover the rule by ; 

induction, but can learn to utilize it with the aid of yerbal tutoring; in the j 

third, they can discover the rule and utilize it without verbal tutoring." 

His study suggests that many children would profit from instruction during the J 

rule utilization phase. 



The task involved in this experiment was that of listening to a rule and 
then applying it to a variety of instances. While this task seems fairly 
straight-forward, the evidence from the study reported in Chapter 3 indicates 
that it is one in which performance can be considerably Improved with practice. 
This is true even though the attributes are familiar to the child and the de- 
finition of the concept is fairly simple. 
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TABLE 11 

Comparison between Rule Verification and Rule Application 



Assumption; 



Task ; 



Question Posed ; 



Rule Verification 

Validity of rule 
indeterminate 

To verify rule 



"This is a posi- 
tive' instance 
of the concept ; 
could the rule 
define th^t 
concept?"*' 



Rule Application 
Rule is valid 



To identify 
instances as 
positive or 
negative in- 
stances of the 
rule 

"Are these in- 
stances of the 
concept as de- 
fined by the rule?" 




j 

i 



-* 

i' 

a 

i 






Concluding Action ; 

If answer to the above question was 

"Yes" and was correct 

% 

"Yes" and was incorrect 
"No" and was correct 
"No" and was incorrect 



Retain rule 
Reject rule 
Reject rule 
Retain rule 



Name of Process ; 

If the rule given to subject by; 

1) Subject himself Hypothesis testing 

2) Teacher or experimenter Rule verification 
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Identify instance 
as positive 

Identify instance 
as negative 

Identify instance 
as negative 

Identify instance 
as positive 



Rule application 

Deductive concept 
learning and rule 
application 







Conceptual Rules 

Haygood and Bourne (1965) have indicated that where two focal attri- 
butes partition a population, the 10 distinct rules constitute five pairs, 
one member of a pair being in one sense the complement of the other* The 
five pairs of conceptual rules are: affirmation and negation; conjunction 

and alternative denial; Inclusive disjunction and joint denial; conditional 
and exclusion; biconditional and exclusive disjunction. 

In Chapter 3, it was noted that kindergarten children from lower class 
neighborhoods had no difficulty with affirmation, which was a very simple 
kind of rule for them to follow. The four conceptual rules adopted for this 
investigation, therefore, were negation, conjunction, inclusive disjunction, 
and joint denial. In their experiment, Haygood and Bourne used the last 
three rules, but instead of negation, which was not a difficult rule for 
their subjects, they used the conditional. 

The ability to use these rules involves language learning, particularly 
listening comprehension, where the child responds to the critical words in 
the rule. The different conceptual rules in this experiment require that 
the child pay attention to the following three words: not , and , or. These 

are the "little words," already discussed as function words in Chapter 2, 
with which, according to Bernstein, culturally deprived children have dif- 
ficulty. It would seem reasonable that the child who has been required to 
verbalize overtly the rules involving these function words will be more 
likely to pay attention to them and to use them appropriately. 

Level of Complexity 

Laboratory studies have usually used simple and highly controlled ma- 
terial for the experimental tasks. For example, Wason and Trabasso each 
used the dimensions of color, size, shape, and number. Having students 
identify concepts such as "the large red circle" offers considerable pre- 
cision. The strategy involved is that of building a model which applies to 
highly simplified instances and to increase its complexity slowly during 
successive experimental sequences. In this way a final model of high com- 
plexity can be developed. 

An alternate strategy is to start with the highly complex concepts and 
materials of the classroom and to attempt to deal with these in order to 
discover the relevant dimensions. In later stages one can then carry out 
studies on a more abstract, controlled basis, using the dimensions which 
have been isolated in the preliminary stage. This latter strategy has con- 
siderable merit in that experimental studies carried out in laboratory 
settings do not consider important classroom variables. 

In the present project an intermediate position was tfaken. The complex- 
ity of the tasks varied in terms of the irrelevant factors pres'ent. The 
concepts adopted were similar to those the child might be exposed to in 
school. The attributes, e.g., earrings and glasses, were everyday objects 
of the child’s environment. (See Appendix 6 •) Since the child was re- 
quired to identify pictures in which these objects were present, a major 
consideration was whether the child interpreted the pictures in the way the 
examiner Intended. A variety of drawings were used so that a good deal of 
Irrelevant material was always present. 
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Another source of complexity in the present study was the mode of pre- 
sentation of the rule. Here the subjects had to learn to extract the rule 
when it was embedded among irrelevant . statements. That is, for every prob- 
lem in the final task, the children were presented with a rule as well as 
with an irrelevant sentence. Given this "noisy" stimulus the child had to 
select the sentence containing the information which was appropriate for 
the question being posed. 

Criterion Tes t s 



Two types of criterion tests wpre used: rule application and concept 

identification. The first of these involved deductive learning of the rule 
while the second required identifying the correct rule through induction. 

1. Rule Application Test . On the rule application subtest, there 
were eight problems, two for each of the four conceptual rules. The test 
is presented in Appendix 7 . The types of problems used are presented here 
arranged according to the type of conceptual rule. However, in the actual 
test the items were scrambled so that no two rules were ever given in suc- 
cession. 



Negation Tony’s mother does not wear a watch. 



The new teacher does not wear glasses . 
Conjunction Fatso Pig is wearing a bell and has spots . 

Richard’s sweater has buttons and sleeves . 
Disjunction The lady bus driver wears earrings or a necklace. 



Betty’s brother is dressed like a policeman or a 
spaceman . 



Joint Denial Jimmy’s favorite present has no wheels and no ribbon. 



Lilly’s purse has no handle and no zipper . 



For each of the problems in the test, the children were told a story 
in which the characteristics of a missing object or person were described. 
This description constituted the concept-defining rule. The goal for each 
problem was always stated at the beginning of the story. E.g., "Jimmy has 
lost his sweater. Let’s help him find it." For one-half of the problems, 
the critical concept-defining rule was given immediately, with an irrelevant 
statement second; for the other half of the problems the reverse order was 
followed. After the rule was given, the child was shown a card with two 
or three pictures and asked to identify which one might be the object or 
person. The correct picture represented the positive exemplar of the con- 
cept while the distractors represented negative instances. 



The following is a typical problem: 

"Who could be Edward’s new teacher? The new teacher 
does not wear glasses. He has a ring on his finger. Point 
to the one that could be Edward’s new teacher." The child 
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was then shown five cards, each showing a picture of a face 
with glasses and one without glasses* The instruction to 
"point to the one who could be Edward's new teacher" was 
repeated with each card. 



There were five cards for each problem, with two or three alternatives 
per card, making a total of 10 to 15 pictures per problem. In order to 
bring the story to a satisfying conclusion, the positive instance (the miss- 
ing object) on the last item of each problem was identified by the experi- 
menter. 



Before the eight problems were presented, all the children were given 
special preliminary training in answering these kinds of questions. This 
training consisted of two parts. In Part I, the child was given a sample 
problem involving affirmation (a rule not used in the experiment because it 
was too simple) and then required to apply the rule to a set of three items, 
without error, twice in succession. If the child missed any of the items 
in this problem, the instruction was repeated with as much additional as- 
sistance as was necessary until the entire set of three items was passed 
without error, two times in a row. In Part II a new affirmation rule with 
five items was presented to make sure that the child truly understood what 
fio do. It was found that in practically all cases those children who had 
demonstrated competency in following instructions in Part I passed all the 
items in Part II, providing some assurance that the instructions to the 
major part of the test were fully understood. 



2* Inductive Concept Identification Test . The second part of the 
criterion test consisted of three concept identification problems, one 
problem being given t;; the children each day over a three— day period. In 
Appendix 8 will be found Problem 1* For each of these concept identifi- 
cation problems, the child was shown a card on which were drawn rectangular 
boxes. Each box contained two pictured objects. The child was told to find 
correct box on each card* After the child pointed to the correct pic- 
ture he was given confirmation and the next card was shown. There were a 
total of eight cards per trial. A new set of cards was presented for the 
second trial and then the two sets were shown again for the third and fourth 
trials. If necessary, as many as eight trials could be given, continuing 
the procedure of the first four trials, or until the child could select the 
correct box on eight successive cards. 

The rules for the inductive problems were as follows: 

(1) Joint Denial "Not a comb and not a ring." 

(2) Alternative Denial "Not a carrot or not pants." 

(3) Disjunction involving Conjunctive Attributes "Bone and 

hammer or leaf and tape." 

It will be noted that the rule used for the first problem. Joint Denial, 
was also used in the rule application program. The second problem involved 
a fifth conceptual rule outlined by Haygood and Bourne, Alternative Denial , 
the complement of Conjunction . The third problem involved quite a difficult 
i^ule. Disjunction Involving Conjunctive Attributes . 
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In scoring the inductive problems, the total number of errors on all 
trials combined was taken as the measure of performance. is not to bore 

children by repetition of a task once mastered, for the children who reached 
the criterion by passing on a single trial (a set of eight cards without 
error) , it was assumed that they would have continued without error for the 
full eight trials. 

Subjects 

As indicated earlier, the program was administered in two stages. In 
the first stage, the original oral program was given to eight children in a 
day care center, with eight children from another day care center in the 
same neighborhood serving as a control. Unfortunately, it was not possible 
to provide instruction at both sites, hence random assignment to both treat- 
ments within each center was not undertaken. Because of attrition, the final 
number of subjects for this stage was 12, with six in the Oral group and six 
in the Control. In the second stage, eight additional children were given a 
Non-oral adaptation of the original 6ral program. Children in this Non-oral 
group selected responses for multiple choice items, and answered only Yes 
or "No" to questions. The subjects in all three groups were Negro children, 
approximately five years of age, ranging from 58 to 62 months. 



Instructional Program 

The instructional program for the Oral group consisted of four sections. 
The first unit dealt with negation, followed by conjunction, disjunction, 
and joint denial. Within each of these units a sequence of six major steps 
was followed: (1) Children were presented with problems in which only the 

rule was given. The child was asked to apply this rule to a single item, 
for example, "Which picture shows a dog with no collar?" (2) The child re- 
peated the rule "A dog with no collar" and then selected an appropriate 
picture from among three alternatives. In this stage, children were pre- 
sented with the same rule, repeated the rule, and then selected pictures 
from a series of items. (3) The children were presented with the rule de- 
scribing an object. They were then asked to point to the object, for exam- 
ple, "Rover is a dog with no collar. Point to Rover." Here the children 
again repeated the rule and were expected to identify the picture on one 
item only. (4) The procedure was the same as in Step 3, but the rule was 
applied to a series of items. (5) Each conceptual rule was presented along 
with the irrelevant statement. Again the child repeated the rule and iden- 
tified the correct picture. (6) The same sequence was followed as in Step 5, 
except now the child applied the rule to a series of items. 

The oral response for each rule required the child to repeat the rele- 
vant part of the rule for purposes of self-cueing. In the example given 
above, the child would be instructed to repeat "no collar" fcr each card 

in this series. 

Children were shown 20 examples of each of the four conceptual rules, 
using the attributes listed in Appendix 6 . The rules were presented so 
that a fairly random sample of attributes were used. (Appendix 9 presents 
a sample lesson from this instructional sequence.) 
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For the instructional program, the attributes consisted of separate 
pictures duplicated from a standard picture file. The use of a file con- 
taining a large number of pictures allowed the efficient production of the 
many frames required for training. The positive instances of the concep- 
tual rules of negation and disjunction involved only one picture while the 
other two rules, conjunction and joint denial,, required two pictures placed 
together. 

The general format for instruction used stories as a setting for the 
task activities. For example, the following story was used to teach nega- 
tion to the Oral group: 

"It was late at night and everything was quiet at the toy store. All 
the people were asleep except the toy people. 'I'm hungry,' whispered the 
toy cowboy. 'I'm hungry too,' said the toy Santa Claus. So the toy people 
decided to look for something to eat. 

(Problem 1) "Let's find all the things the cowboy picked to eat. He 
did not eat a pie. Say, 'not a pie',.. Point to one of the things the cow- 
boy picked to eat. (Show first card consisting of two picture choices, one 
of which is a pie.) Find something else the cowboy chose to eat. (Show 
second card, also with two choices, one of which is a pie. Repeat procedure 
for next five items.) 

(Problem 2) "Now let's find all the things Santa picked to eat. He did 
not eat popcorn. Say, 'no popcorn' .. ."(Five pictures were then shown.) 

Administration of Program 

All children were given tests and instruction on an individual basis by 
the experimenter. An assistant was assigned the task of recording the child's 
responses and other anecdotal material. All tests and instruction Involved 
showing the child pictures along with a commentary. Every effort was made 
to establish rapport with the child but without affecting the standard in- 
structions. The lessons or tests took between 8 to 12 minutes each day. 

The testing and instruction were carried on in an area where, unfortunately, 
occasional disturbances were created by staff or pupils entering the room. 

For any given child, these probably occurred once or twice during the entire 
experiment . 

Table 12 presents the testing and instruction schedule for the 13 day per 
iod. On the first day there was a short orientation in which the children 
were put at ease by the experimenter; they were asked simple questions in- 
volving picture identification. The second day all subjects were given 
the rule application pretest. The children in the two experimental groups 
then came in every day for a period of seven days. The first three of these 
daily lessons dealt with negation, which was judged to be of central impor- 
tance. The three conceptual rules, conjunction, joint denial, and dis- 
junction were then taught in one daily lesson apiece for the next three days. 
On the last day of instruction the experimental groups received practice 
using all four rules. Systematic reviews of all the previous learning were 
held at the beginning of each daily lesson. Four days were then devoted to 
the two post tests. On the first day, the rule application test was given, 
and on each of the remaining three days one of the inductive concept identi- 
fication problems. 
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DAY 



1 



2 



3 

4 

5 

6 

7 

8 
9 



10 

11 

12 

13 






TABLE 12 

Schedule for Testing and Instruction 



ACTIVITY 



Orientation 



Rule Application Pretest 



Instruction; 



Negation 

Negation and Review Items 

Negation and Review Items 

Conjunction and Review Items 

Joint Denial and Review Items 

Disjunction and Review Items 

Review Items on Total Instructional Program 



Posttests t 

Rule Application Test 

Inductive Concept Identification, Problem 1 
Inductive Concept Identification, Problem 2 
Inductive Concept Identification, Problem 3 
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Results 



First Stage 

In this section, the Oral and Control groups will be compared. Al- 
though subjects were not randomly assigned to these two groups, the popu- 
lations from which they were drawn appear to be so comparable that the 
usual tests of significance have been made. However, it should be kept 
in mind that interpretations of the results are subject to this reserva- 
tion. 



On the rule application test, the Oral group moved from a mean error 
score of 26.8 on the pretest to a posttest mean of 15.5, a gain of 11.3 
points. The Control, however, showed on the average little improvement; 
they had a pretest mean error score of 22.5 and a posttest mean score 
of 21.3, a gain of 1.2 points. The difference between the two gain scores, 
using a nonparametric test, is significant at the .05 level. The analysis 
of cbvariance (see Table 13) also revealed significant differences, thus 
supporting the conclusion that the dral program did produce a reliable im- 
provement in the ability to apply rules. 

On the concept identification problems, the Oral group was consider- 
ably better than the Control. The overall mean error score for the in- 
structed group was 15.3 while the mean for the Control group was 27.2. 

On the basis of a 2 x 3 analysis of variance (see Table 14), using a re- 
peated measures design with two treatments and three problems, it may be 
stated that the difference between the two groups was significant on these 
inductive problems. 

Final Stage 

A few weeks after the completion of the Oral program, the non-oral 
program was administered to eight children drawn from the same day care 
center as the Oral group. While the assumption of random selection is thus 
not technically tenable, the fact that these children were from the same 
population and received instruction in a standardized format, seems to just- 
ify the use of statistical measures for random samples. Thus all three groups, 
the Oral and the Non-oral instructed groups and the uninstructed Control group 
have been Included in the same analyses. 

The mean error score on pre- and posttest administrations of the rule 
application test for the Non-oral as well as the Oral and Control groups are 
given in Table 15. It may be noted that the Non-oral group showed a gain of 
4.6 which was intermediate between that of the Oral and the Control. An anal- 
ysis of covariance, presented in Table 16, failed to show a significant dif- 
ference among the three groups. In Figure 9 are presented the graphs for each 
of the three groups to show the change from pre- to posttest for each of the 
four types of rules. It should be noted that the Oral group improved a good 
deal on each of the rules, the Non-oral improved on Joint Denial and Negation, 
whereas the Control group showed little pre- post differences on any of the 
subtests. 



Figure 10 shows the mean progress over each succession of trials for the 
three concept identification problems, by treatments. The results of a repeated 






TABLE 13 

Analysis of Covariance on Rule Application Test 
for Oral and Control Groups 
With Deductive Pretest as Covarlate 



Source 


df 


MS 


F 




Total 


10 






Error 


9 


32.28 




Treatment 


1 


227.13 


7.04* 



*p < .05 



TABLE 14 



Analysis of Variance on Inductive Concept Identification Problems 

for Oral and Control Groups 



Source 


df 


MS 


i. 


F 





Between Subjects 

. A. Treatment (Oral 
vs . Control) 

Subjects within Groups 

Within Subjects 

B. Problems 

AB 

B X Subjects within Groups 



11 

1 

10 

2A 

2 

2 

20 



1284.03 

176.41 



3545.59 

1.69 

58.46 



7.28* 



60.65** 






p^.05 

It 

p<.01 
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TABLE 15 



Pretest and Posttest^^r Rule Application Test 
for Oral, Non-oral and Control Groups 
With De'duCtive ’Pretest^as' Cotrariate 



Pretest Posttest 

Group N Mean SD Mean ^ 



Control 


6 


22.5 


3.0 


21.3 


2.9 


Oral 


6 


26.8 


2.8 


15.5 


3.1 


Non-Oral 


8 


24.5 


2.9 


19.9 


3.2 




1 

TABLE 16 I 



Analysis of Covariance on Results of Rule Application Test 
for Oral, Non-oral and Control Groups 
With Deductive Pretest as Covarlate 



Source 


df 


MS 


F 





Total 


18 






Error 


16 


49.4 




Treatment 


2 


106.4 


2.15 








Figure 9. Pretest and Posttest Errors on Rule Application Test 
by Conceptual Rules for Each of Three Groups 
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measures analysis of variance for total scores (see Table 17) show that the 
differences among groups are highly significant. On the first problem, 

Joint Denial, the children In the two Instructed groups showed rapid learning 
of the rule, whereas the Control group presented a pattern of very slow 
acquisition. A similar pattern can be seen for the second concept Identi- 
fication problem. Alternative Denial, even though this was somewhat differ- 
ent from the kind of rule encountered In the program. While the third con- 
cept Identification problem. Disjunction Involving Conjunction, was much 
more difficult for all children, the difference between the progress of the 
Instructed and uninstructed group Is still apparent. It Is of Interest to 
note when, at the conclusion of the Individual testing situation for each 
problem these children were asked hew they knew which picture to select, 
not one was able to state the rule at all. 

Discussion and Conclusions 



The results from the first stage clearly Indicate that the oral 
Instruction program was effective in Improving performance on the rule ap- 
plication task. This finding Is of particular Interest since the posttest 
Included problems which were somewhat different from those given during 
training. The training consisted of Instances In which each attribute 
was a total picture In Itself, e.g., a box containing a toy car and a hat. 

The posttest, however, presented the child with Instances In which the at- 
tributes were part and parcel of the total picture, e.g. a lady with earrings 
and a hat. The post test was thus to some extent a transfer test. 

On the Inductive learning best the superiority of the experimental 
groups over the control can be understood In part through the fact that 
the test Involved the same kind of problems as the training. Part of the 
superiority of the experimental groups may therefore be attributed to 
specific factors such as familiarity with the pictorial material. Even so, 
however, the Inductive problems on the test were very different from those 
given during Instruction; this finding suggests the importance of exploring 
further the possible transfer values of such Instruction In rule applica- 
tion. 

The Improvement between pre- and posttest for the Instructed group Is 
fairly substantial. While there appears to be far more room for Improvement 
on the part of these young subjects on this task, the posttest was designed 
to be fairly difficult so as to tease out any differences between the exper- 
imental groups which might differentiate the training effects. A number of 
other factors which were Involved in the posttest performance need to be 
considered: 1) The program Itself was fairly short with only a limited 

amount of time which these children actually spent In training. The lessons 
took approximately 10 to 12 minutes per day with a total Instructional time 
of about one hour and a half. 2) While the drawings presenting the attri- 
butes had been checked for familiarity and clarity with a comparable pop- 
, ulatlon, these children may not have had as much experience with the at- 
>trlbutes as was anticipated. 

Comparing the posttest performance of the Oral and the Control, there 
Is dramatic evidence to support the value of the kind of Instruction 
provided In this experiment. The Oral group showed very clear Improvement 
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TABLE 17 



Analysis of Variance on Concept Identification Problems 

for all Treatments 



Source 


df 


MS 


F 




.. . 



Between Subjects 
A (Treatments) 



Subjects within groups 



19 

2 

17 



915.82 

185.40 



4.94* 



Within Subjects 
B Problems 



AB 



40 

2 

« 

4 



5336.71 

13.87 



11.08** 



* 



B X subjects within 
groups 



34 481.70 



*P<.05 



** 



p<.01 
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on the test even though the items were substantially different from the 
items in the instructional program. Clearly lower class children may 
profit by having their attention called to the importance of function 
words such as and, or, and not. By providing practice in listening to 
rules or descriptions, these children show improvement in following in- 
structions and understanding what is said. 



It is possible of course that part of this improvement was attributable 
to the ability of children to deal with the specific pictorial features 
involved in this type of task. It may be desirable in subsequent studies 
to have a control group encounter the same types of attributes and pictures 
but without practice in applying the conceptual rules. These control chil- 
dren might be asked simply to identify pictures that correspond to a 
particular description, in other words, the control group here would be 
given practice with only the simple conceptual rule of affirmation. 



Of special interest is the finding that the experimental groups perform 
so much better on the concept identification problems. On the first 
problem the advantage could be expected, since these children had already 
experienced joint denial as a type of rule. On the other hand, they had 
also been given other rules which could have offered interference in the 
new learning. However, on these new problems, where the rules were somewhat 
different from those encountered during instruction, the superiority of e 
instructed groups is evident. The finding appears to support the notion 
that in inductive concept learning an important part of the process is 
that of hypothesis testing. For this study, however, this explanation 
canndt be supported. Even though’ these instructed youngsters .were able^ 
ib ideritify'".the appropriate :pbsitive instances, none of them were able to 
verbalize the rule. 



It is possible that the experimental groups had an advantage simply 
by being familiar with the pictorial boxes used as stimuli in the task. 
For greater experimental rigor in future studies, it would be desirable 
to give the Control groups experience with these types of materials. 



The data did not support the major hypothesis of the study, providing 
no evidence that verbalization of the rule increased the child ^ c^petency 
in applying rules on the one hand or discovering rules in concept identif 
cation problems on the other. While the differences in general favored 
the Oral group, they were not reliable. With the few cases used in this 
studyrihlre a dLger of making a Type II error. In the Investigation 
reported in the next chapter, the same hypothesis was included among 
those tested. Here, however, a much larger population of subjects was 
used and the results can be accepted with greater confidence. 
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Chapter 7 



THE ORAL RESPONSE IN THE ACQUISITION ^ 

OF INFERENTIAL LISTENING SKILLS BY KINDERGARTEN CHILDREN 



The following experiment was designed to study the value of the oral 
response during a fairly long curriculum sequence. The study, including 
pre- and posttesting and administration of the lessons, covered a period 
of approximately 12 weeks. It was carried out under conditions which 
approached those of a typical classroom. For example, while maintaining 
fairly replicable conditions, the instruction was carried out with five 
or six children at a time, groupings which might be found in a typical 
kindergarten classroom. 

Definition of Listening Skills Selected 

In this. investigation, attention was focussed on the importance of 
the spoken response in helping the child draw inferences after listening 
to a set of statements. The goal of the instruction was to improve the 
child’s ability in certain listening skills, defined as follows: 

(1) When presented with simple class inclusion or probability state- 
ments involving a verbal quantifier (i.e., all , some , or none), the child 
will respond to a question based on the statement by indicating which one 
of three possible answers is correct. 

(2) When given a concept defining rule involving negation, conjunc- 
tion, disjunction, or joint denial, the child will identify positive in- 
stances of the concept by selecting the appropriate picture. 

In addition, the instructional program was designed to teach listen- 
ing comprehension of certain concepts and principles in a nature study 
unit on undersea lifer 

Hypotheses 

Three types of criterion measures were adopted for the study: 

(1) A Program Mastery Test over the content of a nature study unit (Lis- 
tening Test of Specific Content) ; (2) Two Concept Application Tests (a 
Test of Listening Inference using the quantifiers all , some , or none , and 
a Rule Utilization Test applying conceptual rules) ; and (3) a Listening 
Skill Transfer Test (Following Directions and Using Information), 

The following hypotheses were tested: 

(1) Children given instruction in speaking aloud while learning 
to use orally-presented information will obtain higher scores on the 



^A version of this chapter was accepted on the program of the 1969 
meeting of the American Educational Research Association to be presented 
as a paper entitiled, "Young Children’s Use of Language in Inferential 
Behavior," by Carolyn Stern and Evan R, Keislar. 



criterion measures than children given the same instruction without being 
required to speak aloud. 

(2) Both of these instructed groups will be superior to a con- 
trol group given the pre- and posttests but not the training program. 

General Organization of the Study 

The investigation was organized into three phases, each with its 
own criteria, in order to test different aspects of the hypotheses. In 
Phase 1, the first type of listening skill was taught. Children were 
given experience in drawing simple Inferences from orally-presented in- 
formation involving class inclusion and probability. In Phase 2 the em- 
phasis was upon listening comprehension using concepts and principles in 
a nature study unit. Since the material was directly taught in the pro- 
gram, the criterion was a Program Mastery Test of Listening Comprehension 
over the content of the unit. In Phase 3 the instruction again focussed 
upon concept application. Children were taught to listen to a concept- 
defining rule and then to apply it to a series of positive and negative 
Instances. Post tests were given at the end of each phase to assess the 
cumulative Impact of the program. 

Method 



Subjects 

The 124 subjects were selected at random from 10 jcindergarten classes 
in a mid-city urban public school. Over 95 percent of the children were 
black. Five of the classes met in the morning and consisted entirely of 
first semester kinder gar tners; the five afternoon classes, taught by the 
same teachers as the morning sessions, contained second semester pupils. 
Over the three-month period of the study, 16 pupils were lost through 
attrition, thus complete data were available for a total of 108 children. 
The age ranged from 59 to 71 months, with a mean of 64 months. The mean 
mental age, based on the Peabody Picture Vocabulary Test, was 58 months, 
with a range of 31 to 96 months. There were a total of 53 children 
attending the first semester and 55 attending the second semester kinder- 
garten classes. The sample consisted of 56 boys and 52 girls. These 
subjects were assigned at random to each of the three experimental groups: 
Oral, Non-oral, and Control. Table 18 presents data for sex, kindergarten 
level, chronological and mental age, by treatments. There were no re- 
liable differences among the three groups on any of these variables. 

General Instrufction and Testing Procedures 

All testing and instruction were carried out in a room, somewhat 
smaller than a regular classroom, in the building adjacent to the kinder- 
garten rooms. The tests were individually administered to each child. 

Within each treatment, the instruction was carried out in groups of 
five children. All the children in a group were escorted to the experi- 
mental room by an assistant. While that group was being instructed by 
the experimenter, the assistant escorted the previous group back to the 
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classroom and returned with the next group of five children. In this way 
it was possible to schedule eight sessions during the morning and another 
eight during the afternoon, making 16 small groups with a total of 80 
children. 

The -instructional procedures during the lesson were carried out, in 
so far as possible, in a replicable fashion. Most of the lessons were 
given in a modified programmed instruction format. However, whenever 
manipulanda was used, the procedures were more informal. 

For the programmed lessons children were each given booklets vith 
one frame per page. Commentary was usually provided by a tape recorder, 
with each child listening through his own earphones. (See Appendix 10 
for sample frames,) In order to reduce distractions from other children, 
dividers were placed on the tables so that each child could see the re~ 
search assistant but not the ’Other pupils. Two views of the seating 
arrangements, with individual dividers between children, can be seen in 

Figure 11. 

On some occasions, partly to provide variety but partly to offer 
modes of instruction more relevant to a particular task, children were 
given manipulanda with which to work. During Phase 1, for example, chil- 
dren worked with checkers, blocks, boxes, etc. On other occasions, one 
large stimulus was presented to all five children. For example, the unit 
on undersea life used a "porthole"(Eigure 12) as a frame in which were 
displayed pictures illustrating the story; children indicated their ans- 
wers by holding up individual response cards. 



Phase 1 



‘•VVJ 



The objective of Phase 1 was to teach the child to respond appropri- 
ately when he heard the verbal quantifiers: all , some, and none, as well 
as the corresponding terms always . sometimes , and never . After the chil- 
dren listened to a single statement which included one of these quanti- 
fiers, they were required to demonstrate understanding by answering ques- 
tions involving simple Inferences based on the statement. The child ^s 
answer to such questions was one of three responses: yes , no, or can*t ,tell. 
A major objective for this unit was to teach the child to withhold judgment, 



Pretest 



A pretest of 18 items was administered individually to each child in 
both experimental and control groups. Following a sample item, the child 
was given a six-item test of negation; i.e., he was required to identify 
three of six pictures idiich were not examples of the stated concent. E.g.. 
"Mark all the pictures which do not show something good to eat." Another 
series of items assessed the child* s ability to interpret a conditional 
statement. E.g., "If Mary sees a cat she is happy. Mary sees a cat. Is 
she happy?" The next six items dealt with verbal quantifiers. E.g., "All 
the clowns with striped suits have big noses. This clown has a striped 
suit. Does he have a big nose?" 



On the negation subtest , children obtained an average score of 75 per- 
cent where 50 percent represents a chance score. On the test dealing with 
verbal quantifiers, the average score was at a chance level. (See Table 19.; 
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TABLE 18 

Description of the Three Experimental Groups 



Treatment 

Groups 


N 


Sex 

B G 


Kindergarten Level 
1 2 


CA in 
Months 


MA in 

Months 

(PPVT) 





Oral 


38 


19 


19 


19 


19 


Mean 
S .D. 


64.3 

3.6 


55.1 

13.5 


Non- oral 


36 


20 


16 


17 


19 


Mean 

S,D. 


64.7 

3.8 


60.2 

14.1 


Control 


34 


17 


17 


17 


17 


Mean 

S.D. 


64.4 

3,2 


58.5 

14.4 



TABLE 19 

Means and Standard Deviations of Groups 
- for Three Listening Inference Pretests 



Treatment 

Groups 


Negation^ 


Conditional^ 


Class ^ 


Total‘S . 





I 

I 

i 



Oral 


Mean 


29.2 




1,6 


2.1 


32.9 




S.D. 


7.2 




1,0 


.9 


7.5 


Non-oral 


Mean 


31.3 




1,9 


2.2 


35.4 




S.D. 


7.5 




lo3 


.9 


7.7 


Control 


Mean 


30,5 




1.6 


2.4 


34.4 




S.D. 


8.2 




1.1 


1,0 


8.3 


Total possible 


score is 


40; 


chance * 20. 






^Total possible 


score is 


3; 


chance = 1 , 
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Criterion Test 

The major criterion for Phase 1 of the experiment was a test designed 
to measure the child’s ability to draw Inferences, given statements involv- 
ing the words all, some, or none. These terms were extended to include 
corresponding statements with the words always, sometime^ , or £eyer. The 
Listening Inference Test Is presented In Appendix 11. The 17 It etas In he 
"test V^^ied from simple picture identification to statements requiring 
drawing inferences with three dimensional materials. It was administered 
on an individual basis to each child in the experimental and control groups. 

Two features of this test should be noted: (1) It was designed as an 

"individual test. While this meant that fewer items could be included in 
the test, with concommittant loss in reliability, -- 

was an individual one increases the likelihood that all children, especial y 
those in the control group, would perform at an optimal level. On group 
tests, children without experience in testing often receive low scores 
simply because the group instructions are difficult to 

child may do poorly not because he lacks knowledge or ability but because 
he fails to understand the task. (2) The test is essentially a transfer 
test for the experimental groups. For example the items dealing with 
classes used cards which presented the same problems within a different 
context. To assess understanding of sometimes children were presented 
with spinners which were quite different from any instructional item en- 
countered in the program. 

The Instructional Progra m, for Phase 1 

The instructional program for Phase 1 covered a period of approximately 
six weeks, divided into Phase lA and Phase IB. During Phase lA, which in- 
volved two and one-half weeks, both experimental groups were taught to ; 
withhold judgment, i.e., to say, "Can’t tell," when presented with 
ficient information. The children were given a variety of problems where 
the correct answer was "Ves" or "No" or, where insufficient information 
was presented, "Can’t tell.". 

ks an example of the instruction given in Phase lA, Lesson 6 is given 
in Aooendix 12. All children responded in two ways: either by marking 
approp^ pictures or by saying aloud one of the three possible responses. 

In Phase IB, Oral and jion-oral treatment differences were introduced. 
Children in the Oral group were told to speak the key word or sentence for 
each item Just before they made their selection of the picture. Children 
in the Non-dral group made the selection without speaking. 

During the few sessions where programmed booklets were not used, the 
same distinction in the instructions was maintained. Men*ers of tte Oral 
group spoke out many times during each lesson, using the critical 
Is cues for answering the questions. In general, the children in the Hon- 
oral group remained silent, although occasionally there was some spontan- 
eous and unsolicited oral responding. 

Children in both experimental groups were taught to deal with simple 
statements involving verbal quantifiers. The first items involved infer- 
ences of the following types: 
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Figure 11. Two Views of Seating Arrangement with Individual Dividers 




Figure 12 „ Group Display with Individual Response Cards 



All A's are B. Here is an A. Is it a B? (Answer: "Yes") 

Some A's are B. Here is an A. Is it a B? (Answer: "Can't tell") 

No A's are B. Here is an A. Is it a B? (Answer: "No") 

The general sequence of the instruction was first to teach the child 
to describe situations by using the quantifiers appropriately. For example, 
the children described different bowls of fish by using the appropriate 
sentence: " All of the fish have stripes ." " Some of the fish have stripes .'; 

or " None of the fish have stripes ." 

Children in the Oral group repeated the sentence before selecting the 
bowl described; the children in the Non-oral ^roup heard the sentence and 
selected the appropriate picture. (Appendix 13 shows treatment coraparison.) 

The same type of task was taught with manipulanda. Children were 
shown a box in which there were only red checkers. The experimenter se- 
lected a checker from the box, without letting the children see what was 
removed, and asked "Do I have a red checker?" Children were reinforced 
for saying "Yes’.'! Similarly, ^eh. the box contained only black checkers, 
children were reinforced for saying "No" when asked, "Do I have a red 
checker?" On other occasions, the box contained some black and some red 
checkers. Now when a checker was removed and the child was asked, "Do I 
have a red checker?," the correct answer was "Can't tell." To teach the 
behavior of withholding judgment, the problem was introduced with the 
question, "Can you tell for sure?'! 

Several games were included to supplement the programmed books. 

While these informal activities were not completely replicable, they pro- 
duced a high level of motivation and participatio i. 

Pic tur e Box Game 



To help in teaching an understanding of the probability terms, the 
"Picture Box Game" was introduced. Here the child was shown two boxes, 
one called the "cue" box and the other the "consequence" box. The front 
of the "cue" box had three back-lighted glass panels, each 8" x 10" in 
size, in front of which three pictures were displayed. The light behind 
each picture was controlled by the switch below that picture. The 
"consequence" box was one-third as large since it contained only one glass 
panel. The picture in this box was illuminated only when the button under 
the appropriate cue picture was pressed. Whether or not pressing the 
button for any of the three cue pictures would produce a light in the con- 
sequence picture was determined by the setting on the switch controlling 
that picture. The setting for any or all of these cue pictures could be 
such that the consequence picture would light up every time psome_ of the 
time (on a random schedule), or never. 

The game proceeded as follows: Four pictures were first inserted 

behind the glass panels. For example, the three cue pictures might be an 
elephant, a dog, and a horse, while the consequence picture might be a 
clown. The children were told, "One of these animals^ always makes the 
clown laugh; one of them sometimes makes the clown laugh, and one of them 
never makes the clown laugh. Let's find which animal always makes the 
clown laugh." 
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Children «ould take turns pressing buttons and making predictions us 
u-j Vi animal would alwavs , which one would sometimes , and which one 
wLld Lver make the clown laugh. The group always knew which button had 
been pSd^Lause the light would go on in the cue picture. If a child 
selected the picture of the animal which always made the clown laugh, the 
?tehted irevery time. If he selected the one which never made the 
cioTO iaSh ?he clown would not be lighted and an aversive buzzer 

^ faA -inci-ead For the third picture, sometimes the clown lighted 
IZ ToSL Tt dfd'not? in the latLr cas;, the aversive buzzer sounded. 
?ht gaL was played until every child had learned to turn on the appro- 
priate light for any one of the three types of statements. 



Since the pictures could easily be replaced, other kinds of Picture 

Box games could be played, with the control switch 
that^the child would not learn a position cue for all the games. 



The advantage of this type of game was that the child learned to dis- 
tinguish between alwavs and sometimes, and sometime s, and neye^ - ^ 
i /iniihi- existed a child could press one button repeatedly and find 
thfcorrect Slatlinsh^^^^ tLt cue picture and the consequence, 

f g thtfthe cue picture was Indeed sometimes followed by the consequence 

and’ Other times not! Getting repeated confirmations made the disbrimi- 
nation learning easier c 



Path Game 



A paper version of the Picture Box Game just described provided the 
children with a map showing a number of colored paths leading f r m 

a starting point. In this Path Game, all of the paths marked by 
rnln^led t! a specified goal, none of the paths of another color ended 
uo at this goal,^while only some of the paths of a third color 
the goal. By actually tracing the paths with their pencils the childr 

could find out, respectively, which of the three colors a ways,; 

. _ II -I _ A.- A-Ft-or childrBn h£id 6tnpi.. 



le^rthe goal. After the children had empirically 
. . e> __i_j foY' Mh-frh the 



times' and never lea to cne guax. : . u 

these relationships they asked q^stions for^w^^^^^^^^ 

^eTctur: lZ\^AVrZlonl. while the other chil- 

dren watched, the Path Game provided the opportunity for all c i ren 
respond to each item. (See App‘- - 



Results for Phase 1. 



Table 20 presents by treatments, the means and standard deviations 
on the citterion test, as well as the three subtests. The results of the 
analysis of covariance for subtests and total test are given in Tabl 21. 



on the first subtest, (items 1 through 8) in which the child simply 
resoonded "Yes " "No," or "Can't tell," to questions based on information 
olli and Non-ora groups did fairly well; the »eans were 6 8 
70 resoectively, only a point less than the maximum. The Control 
Sup' Mean of 5.8, wL significantly lower- than that .of the experimental 

groups. 
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The second subtest (the three Items in question 9) consisted of a 
problem similar to one which had been included in the program* Given 
oral and visual information about the colors on the sides of a cube on 
which all sides were blue, the children were asked to predict what color 
would appear on the top if it were thrown. They were also asked to make 
predictions for cubes which had some sides blue, or none of the sides 
blue. Since this type of item appeared in the instructional program, it 
is not surprising that the two experimental groups were significantly su- 
perior to the control. However, the Oral and Non-oral groups did not 
differ significantly. 

In the third and fourth subtests (items 10 and 11) the problems were 
entirely new to the Instructed groups and hence could be considered trans- 
fer items. As preliminary training for item 10, children were first shown 
a spinner, consisting of a cardboard pointer mounted in the center of a 
four-inch circle. The three segments of the circle were painted green, 
orange, and purple, respectively, and the child was shown how, by spinning; 
the pointer, one could get different colors. Following this orientation, 
the child was shown three similar spinners, one with an entirely red circle, 
one with a circle half red and half yellow, and pne with an entirely yellow 
circle. The child was asked on which spiniier the pointer would sometimes 
get red, on which one it would always get red, apd on which one it would 
never Ret red. On this item, both instructed groups received a mean of 
2.6 which was significantly superior to the control mean of 1.6. 

Item 11 tested the child’s understanding of the verbal quantifiers, 
"all," "some," or "none." The child was shown a set of cards on each of 
which there was a picture of either a clown or some other object. After 
all the pictures were displayed, the cards were turned over so the child 
could see that the backs of some of these cards were pink, some green, 
and some orange. He was told, "All the pink cards have clowns on them. 

Does this pink card have a clown on the other side?" Then he was told, 

"None of the green cards have clowns on them. Does this green card have 
a clown on the other side?" "Some of the orange cardp have clowns on 
them. Does this orange card have a clown on the other side?" On this 
post test problem the Instructed groups achieved scores of 1,9 and 1.8, 
while the control group received 1.3. The difference between instructed 
and control groups was significant at the .01 level. 

Although the problems were designed with a high level of difficulty 
so as to permit differences between the two experimental groups to emerge, 
the Oral group did not score reliably higher than the Non-oral on any of 
the subtests nor on the total test. While the two esfperimental groups 
did not approach the miaximum score on this difficult test, they were 
clearly superior to the uninstructed control. 

Phase 2 

The Teaching of Specific Concepts in Nature Study 

The major function for Phase 2 was to test the hypothesis regarding 
the value of oral instruction in teaching highly specific subject matter 
content. The concepts taught were related to undersea animals and in- 
cluded specific information which would help.bpth to identify the animal 
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from among three alternatives and to answer simple "yes-no questions 
about them. Since for each Phase the children remained in the same 
treatment group, the results of this part of the study reflect a cumu- 
lative build-up of the effect of the oral response. The Control group 
was not given this instruction and thus could not be expected to answer 
specific questions over the program content. Therefore, the Control 
group was not given any of the tests for Phase 2. 

Hypothesis 

The specific hypothesis of this part of the study was that the chil- 
dren in the Oral responding group who say aloud the concept labels in a 
nature study program, in comparison with those who respond only ^^es or 
"No," will perform better on an identification test consisting solely of 
selection Items, and where oral responses are not required. 



Experimental Plan 

The total time for Phase 2 was approximately two and one-half weeks. 
All children in the Oral and Non-oral groups, approximately 80 in number, 
were given an individual pretest followed by slightly more than a week of 
instruction, and then an individual posttest. 



Instructional Program 



The instructional material was presented in a varied program, includ-* 
ing: (1) Booklets in which children followed a sequence of frames as they 
listened to tape recorded commentary. (See Appendix 15.) (2) Dramatic 

presentations in which pictures were presented through a simulated porthole 
while the children listened to taped commentary and answered questions by 
holding up stick-cards containing pictures of the different animals or 
parts of animals Included in the lesson. 



In this instructional program, the children were taught about five 
undersea animals: the octopus, seahorse, crab, scallop, and coral. The 

children learned where these animals lived, what they ate, how they mo 
about, and how they protected themselves. The examples of the kind of 
concepts and principles they learned will be found in the ^J^fiec 

dixl6 The distinction between the oral and nqn-oral program is exemplifiec 
in AppendixlS which presents a typical lesson for each of these treatments. 



Results for Phase 2 

In Table 22 are presented the means and standard deviations for the 
pre- and posttests for the Oral and Non-oral groups. It will be note 
that on each part of the posttest, as well as on the total, the °tal 
group obtained higher mean scores than the Non-oral. While these diff r 
ences are not significant for the first part of the POSttest ^ 

23 for Analysis of Covariance) on the second Part and ^® ®^ 

test, the Oral" group is reliably superior to the Non-ora g 
thetlcally, it may be noted that the main effects of mratal ap are 
significant only for the first part of the posttest. These findings 
indicate that, with this population, acquisition of specific content 
was facilitated by oral responding. 
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The final two weeks of the study Included a program designed to teach 
children to listen to and apply conceptual rules. From another point of 
view, the children were taught to respond appropriately to three little, 
but Important, words: and , or . and not . In Phase 3, therefore, the 

problem was practically Identical with that reported In Chapter 6. Cri- 
terion tests were given to the control, as well as to both Instructed, 
groups. In. addition, a general test of transfer for listening comprehend’ 
slon was given to the Oral and Non-oral groups. 

The Task 



As In Chapter 6, the task was one of deductive learning. Children 
were given a rule In the form of a simple one or two sentence story, and 
then expected to apply It on three of four successive lt;ems. The task 
was phrased In terms of finding a missing Itpem meeting certain specifica- 
tions, according to one of four conceptual rules: conjunctioPf disjunc- 

tion, joint denial, and exclusion (x and not y). The latter rule was 
substituted for that of negation In this study because t;hese children had 
had a good deal of prior Instruction with negation In Phase 1. 

Children were shown a set of three to four frames, each pf which 
presented three picture choices. Of these thres, one was a positive 
Instance, and the other two were negative Instances, of the concept. In 
order to maintain Interest, on the last Item of Iphe set the experimenter 
told the child that he had found the missing object for that problem. ($ee 
Appendix 17 for sample Item's.) 

Instructional Program on Rule Application 

The Instructional program was similar to the one described In 
Chapter 6, with three Important differences: 1) Most of the negation 

Items were not repeated since this rule had already been taught In Phase 
1. 2) Children In the Oral group were taught to say aloud a few key words 

as a cue to help them remember the rule befpre responding to each Item. 

3) Unlike the previous study In which, during instruction, the -attributes 
were represented by separate objects. In this study the pictures were 
drawn specifically so as to embed the critical attributes In the total 
visual stimulus. Thus the materials used during this program were more 
like the Items In the posttest. 

Criterion Tests 

Three tests were administered at the conclusion of Phase 3. The 
first, the Rule Application Test (see Appendix l$X,^^signed to assess the 
effectiveness of the Instruction, consisted of five problems, each re- 
quiring the application of a rule to a series of Instances. The first 
problem contained three Items and the others four items apiece. As 
Indicated earlier, each problem was couched in a story framework involving 
the search for a missing person or object whose description, consfltuting 
the rule, was explicitly given to the child. Each of the four conceptual 
rules was used for at least one problem; the oonceptual rule of exclusion 
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was used for two problems. The score for the test was simply the number 
of items which the child was able to answer correctly out of a maximum 
possible score of 19. In addition to the total score for all five problems, 
the data for each of the problems were analyzed separately. 

The second and third tests (see Appendix 19) administered at the con- 
clusion of Phase 3 were designed to compare thei cumulative effect, over 
all phases of the study, of the oral treatment versus the non-oral treat- 
ment in fostering broad listening skills. The first of these measured the 
ability to process information. For each item, the appropriate response 
to the final question was "Yes',',' "No" or "Can't tell.'.' After the three 
orientation items, the child was given a statement of the problem:, e.g. 

"I'm going to tell you about Johnny. Listen and see if Johnny has a baby 
sister." On some of the problems, the sentences which followed provided 
the answer to the question posed; on other problems the relevant infor- 
mation was never supplied. The child was then asked to give the answer 
to the problem^ "Does Johnny have a baby sister?" The total possible score 
for this test was 13 points. 

The third test assessed ability to follow directions by marking a set 
of pictures according to specific instructions, e.g. "If it is Not food, 
draw a line through it." On some items these instructions involved com- 
plex statements, e.g. "If it is food, draw a circle around it and if it is 
an animal draw a line through it." The first item contained six pictures; 
the remaining four items had 18 pictures apiece. On this test, the total 
score possible was 60 points. 

Results for Phase 3 



The results of the Rule Application Test for each of the three treat- 
ment groups are presented in Table 24. Here it may be noted that while 
the differences between the Oral and Non-oral groups are fairly small, both 
these instructed groups performed somewhat better than the Control on every 
problem. The significance of the differences for problems and total test 
were obtained by 2 x 3 analyses of variance, using two levels of mental 
age and three treatment groups (see Table 25). As the data indicate, the 
differences among the three groups are reliable not only on the total 
score, but they are reliable for each problem except problem 5. 

The differences between the individual pairs of means, using the 
Neuman Keuls Test, are shown in Table 26. It will be noted here that 
both of the experimental groups are significantly superior to the Control 
of the Total Testj The Oral group is significantly superior to the Control 
on problems 1, 2, 3, and 4, while the Non-oral group is reliably better 
than the Control on problems 1, 2, and 4. The only significant difference 
between the Oral and Non-oral groups is for problem 2, where the Oral was 
higher . 

The main effect for mental age is significant for the Total Test, as 
well as for each of the five problems, but no interactions were found to 
be significant. 

The listening tests produced unanticipated results with reference to 
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the major hypothesis. The Non-oral group, contrary to expectations, showed 
higher mean scores on both these tests than the Oral group. The results 
given in Table 27 show that the Non-oral group scored several points above 
the Oral on each of these broad transfer measures. (As indicated earlier, 
the Control was not given this test.) To test the significance of these 
differences, a 2 x 2 analysis of variance, two treatments with two mental 
age levels, was carried out. The results of these analyses, presented on 
Table 28, show that the Non-oral group was reliably superior on the first 
listening test, Using Information. On the second test. Following Direc- 
tions, although still favoring the Non-oral group, the differences were 
not reliable. This is the only instance in the present series of studies, 
in which a Non-oral group was superior to the Oral. 

Discussion and Conclusions 

Summarizing the results of the three phases of this experiment, some 
conclusions with respect to the major hypotheses may be formulated. 



I. Oral versus Non-oral Instruction . 

The effect of instructing young children to say aloud critical words 
instead of only listening and responding to multiple choice questions is 
clearly evident with the specific content of the nature study unit. The 
Oral group was significantly superior to the Non-pral on the total test of 
concepts and principles covering the life of undersea animals. This was 
true even when the criterion test did not require children to verbalize 
at all; each of the test items required only an identification response. 



The differences between the Oral and Non-oral groups were generally 
unreliable when the task involved the use of quantifiers, negation, or 
sentential connectives. On these tasks, out of about a dozen comparisons 
only one (a problem on the Rule Application Test) showed a reliable dif- 
ference in favor of the Oral group. On all of the remaining problems, 
the differences, although not reliable, favored the Oral group, except in 
one case where there was an unreliable difference in favor of the Non- 
oral group. No evidence was obtained to support the major hypothesis. 



On the more general listening test, where the task involved skills 
quite different from those developed in the program, the results were 
unexpected: the means of the Non-oral group were higher than those of the 
Oral. While the superiority of the Non-6'ral group was not reliable on 
the Following Directions test, it was clearly significant on the test of 
Using Information. It would appear that the children in the Oral group 
may have learned verbalizing habits which interfered with their perfor- 
mance on a listening task different from the one taught during training. 



II. Instructed versus Control Groups. 



When the performance of the two experimental groups is compared with 
the Control the value of instruction of these tasks is supported on almost 
every comparison. Such a clear cut superiority of the instructed groups 
deserves further scrutiny. 
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TABLE 27 










It might be argued that these obtained differences merely indicate 
that the Control subjects lacked an understanding of the task, rather than 
an ability to perform. For many of the criterion tests this possibility 
can be safely ruled out. For example, the Listening Inference Test 
requires the child to respond appropriately to the terms alwa x s _» sometime ^ 
and never . After being given an introducation to the way the spinners 
workidTThe child was asked to select, in turn, -the spinner which would 
sometimes, always, or nev ^ point to red. These materials were as new o 
the twoTnsITII^d groups as to the Control. For the Rule Application 
Test, the problems were posed in a lifelike form asking the child questions 
which were not unrelated to the child’s everyday life. Children were, for 
example, asked, "Which of these sweaters could be Jimmy s? a type of 
question which they had undoubtedly faced many times . For a large number 
of the test items, therefore, there seems to be little support for any 
contention that the control group was penalized for lack of familiarity 

with the task. 



However, the use of the response alternative, "Can t tell as a way 
of expressing the withholding of judgment raises some questions. the 

control children really understand what was expected of them here. Did 
they understand, for example, that they were not supposed to guess? This 
test was preceded by a rather lengthy instructional program which was 
intended to teach the youngsters that on this test guessing would not be 
rewarded. How extensive should such orientation be? If made too extensive 
it could almost be considered instruction. The orientation attempted to 
provide a reasonable compromise. 



When evaluating the results of an instructional program an important 
question is: "How much class time is it worth expending for the results 

obtained?" The total time taken for instructing children in the task of 
responding to statements involving verbal quantifiers was 
hours, which does not seem excessive. Where more time is available other 
tasks could be added to enhance the effectiveness of this instructionv 
For example, the approach adopted in the present study was one which 
taught children to withhold judgment. An alternative procedure would 
ask the child to respond "Maybe" to indicate whether or not a particular 
outcome is possible (Cf., Ennis, 1965). 



In any event, this study has demonstrated the potential value of 
instructing children to understand, i.e. to respond appropriately to, 
certain linguistic forms involved in the communication of relationships. 
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Chapter 8 

CONCLUSIONS 



In reviewing the course of the project, several major contributions | 

can be enumerated: (1) Data about the nature of language differences 

between lower class and middle class kindergarten children; (2) Evidence i 

regarding the value of the instructional procedure of overt verbalization 
for the development of listening skills in the kindergarten; (3) Informa- 
tion concerning the feasibility of kindergarten curricula directed toward 
(a) ability to apply conceptual rules, (b) withholding of judgment where 
information is insufficient, and (c) understanding the meaning of verbal 
quantifiers and their corresponding probability terms; and (4) Development 
and evaluation of replicable instructional programs with this population. 

Lf^"guage Deficiency of Lower Class Children 

Evidence was collected to support Bernstein *s position that lower 
class children use a restricted language code. This is especially true 
^^rh regard to function words where refinements and subtle discriminations 
are made. On an immediate memory test, lower class children averaged below 
middle class children on all three word classes, however, their deficiency, 
relative to middle class children, is significantly greater in recall of 
function words than of nouns or verbs. It seems that disadvantaged children 
have not learned to respond adequately to function words or to use them in 
their own speech. 

Additional support for the restricted character of the language of 
these children was found in the second investigation, where disadv^taged 
children performed more poorly than middle class children on questions and 
declarative statements. However, they had relatively less trouble than the 
middle class children with sentence fragments which included the key words. 

This suggests that these young lower class children have had less experience 
in responding to complete interrogations, and are relatively less handi- 
capped when the key words are isolated for them. The sentence form in which 
a problem was posed was a confounding variable and may have masked the dif- 
ferences between socioeconomic classes on the use of conceptual rules. 

The Value of the Oral Response 

The cumulative evidence from the sequence of investigations described 
in this report indicates that instructions to verbalize, and subsequent 
overt responding, has measurable value where there is a direct correspondence 
between the stimulus and the verbal response. The reading study confirms an 
earlier finding that verbalization in the presence of the printed word 
facilitates learning. A possible interpretation is that words which are 
overtly verbalized are more apt to operate as cues in a subsequent silent 
reading task. This was true even though the criterion did not involve the 
production of the overt speaking response but rather the identification of 
the appropriate picture or word. 
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The finding that the oral response was helpful in learning concepts 
drawn from the nature study unit may require a different interpretation. 

Here the children were working with relatively unfamiliar labels. Follow- 
ing Underwood^ s two— stage model of paired— associate learning ^ the child 
may be increasing response availability by rehearsing the new response. 

Active rehearsal of these words may have made them more useful as mediators 
for the subsequent task. Whether dealing with such unfamiliar words, or 
the familiar ones of the reading study, the act of speaking a distinct and 
critical response strengthened a highly discriminative cue which could be 
used in the subsequent task. The behavior involved during instruction may 
well have been fairly analogous to the covert behavior in answering ques- 
tions on the criterion test. 

The results of both the reading and the nature study units suggest 
another interpretation. Having the child speak aloud may lead to greater 
attention on his part to the critical features of the visual or auditory 
stimulus; the response may not act in any essential way to produce a cue 
for his subsequent behavior. It should be noted, however, that the non- 
oral groups were not passive; even though they were not speaking, they 
were required to respond continuously by making multiple choice selections 
in answer to the same series of questions. Still, for the oral group, 
speaking aloud may well have called attention to more of the key aspects 
of the stimulus than merely selecting the correct answer. 

The effect of speaking aloud was much less clear in the investigations 
in which function words were used. These words (the verbal quantifiers, 
all. some, and none , negation, and the sentential connectives, ^^d » or) 
were embedded in varied sentence contexts. Negative results were found 
when the verbal quantifier the child was required to say aloud was only part 
of a total sentence. The results did not support the expectation that chil- 
dren would profit by saying aloud the key phrases in rules involving nega- 
tion and sentential connectives. 

However, it should be noted that the materials used here differed from 
those in the reading study or the nature study unit where a clearer cueing 
function of the words is apparent. Furthermore, both the work of Kendler 
and Silverman, cited in the first chapter, show that verbalization was ef- 
fective under conditions where the material was simple; the reversal shift 
learning was enhanced by verbalization because the child was^^only required 
to give a single key word embedded in a stock phrase (e.g., black s the 
winner"). In the present investigations, however, the verbalizations were 
never so algorithmic in character since the child was taught to express his 
responses in many ways. The instructional materials sampled a wide variety 
of content and sentence construction and thus did not permit the child to 
acquire, at least under the instructional conditions provided, a clear cut 
verbal mechanism for self cueing. 

It is still important to note that, while overall reliable differences 
were not obtained with the verbalization of function words, on all test 
and subtest comparisons, the means favored the oral group, in one case re- 
liably so. Greater understanding of the mechanisms involved may be obtained 
if the variety of linguistic expressions were more carefully analyzed and 
systematic provision made for appropriate practice with each form. In ad- 
dition to providing a clearer picture of the conditions in which overt 
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responding is most facilitating, such an analysis would make an important 
contribution to curriculum construction. A more careful task analysis 
and better programming may have, shown a significant superiority for the 
oral group . 

In the study reported in Chapter 4, it was demonstrated that inter- 
ference occurs where the verbal responses produced do not contribute to 
the performance of the given task. Probably speaking aloud produces either 
facilitation or interference, depending upon the functional value of the 
words verbalized. Merely having children speak aloud may serve to main- 
tain superficial involvement without producing the desired learning outcomes. 

In the final experiment there was some concern that requiring overt 
speaking over a period of many weeks might result in mechanical, robot— like 
responding which could Interfere with other learning. Although this negative 
effect was not present where the tests were highly similar to the tasks pre- 
sented during instruction, where the processes differed considerably from 
those of instruction, as in the general listening test, there was clear evi- 
dence of interference as a result of oral response training. It was almost 
as if the verbal procedures acquired by the oral group confused rather than 
aided the children when the tasks involved more general kinds of listening 
skills. To avoid the possibly interfering. effects of overt verbalization, 
it might be of value to provide a greater amount and variety of practice 
during instruction so that discriminations can be formed, and material can 
be overleamed. 

Curricula for. Young Children 

The main focus of the entire investigation was upon developing methods 
for improving the child's listening comprehension in critical areas, espec- 
ially his use of important function words. In planning the curriculum to 
test the oral hypothesis, therefore, it was necessary to simultaneously study 
the feasibility of instructing these children in three new types of compe- 
tencies . 

At the outset it should be recognized that the primary goal of the in- 
vestigation was not to produce the most effective instructional program, 
i.e., one which would result in near perfect scores on the criterion test. 
Instead, in order to obtain a viable discrimination between the treatments, 
it was necessary to develop a program of moderate difficulty; a very effec- 
tive program might have masked any differential effects of speaking or not 
speaking. 

There were three different areas in which new content was explored. In 
the first, data was obtained demonstrating th? potential value of instructing 
young children to respond more appropriately co the critical cues for the 
conceptual rules . Distinct progress in applying concept‘-defining rules was 
found not only in a pilot study involving a dozen chilren (reported in Chap- 
ter 6) but also in the more expanded study with over a hundred subjects where 
such instruction was the culmination of a curriculum unit almost three months 
in length. The total instructional time, between one and two hours, spent on 
rule application appears to be justified by the results. Of interest is the 
fact that, in the pilot study, at least for the oral group, the learning 



89 









T- 



mmmmm. 



generalized to Items which were somewhat different from those in the rule 
application program. Furthermore*., the instructed groups clearly trans- 
ferred their learning to concept identification problems where the task 
involved inducing the rule, not merely applying it. 

The conceptual rules in this project were applied to fairly mundane, 
everyday experiences of the child. It is likely that these concepts are 
most appropriate because the attributes are well known. The child's 
attention can, therefore, focus on the conceptual rule Itself. It should 
also be recognized that a single "slice" of language instruction focused 
around a few critical words can hardly hope to show much Impact on those 
broad language abilities which are called for in a typical classroom set- 
ting. Where an accumulation of such segments are provided in the curricu- 
lum, it could have an important effect on the child's learning of regular 
academic content. Such training might be effectively extended into other 
areas where the concepts are more closely related to academic pursuits. 

These findings support the value of rule application training in im- 
proving the child's abilities, not only to understand the teacher's verbal 
descriptions of concepts but also to discover new concepts on his own.' This 
would be especially valuable for children who come from homes where enriched 
language is not present and much 6f language lemming Is'^left to chance. 

A\second Important outcome (reported in Chapter 7) was evidence that 
young children could be taught to withhold judgment where a definitive "yes" 
or "no" answer is inappropriate. At all levels of education, even among 
adults, individuals are prone to think in dichotomous t^rms, l.e., they 
assume that either a positive or negative response must be correct. This 
limited approach precludes the possibility of asking additional questions 
to explore the problem further. 

Unfortunately, teachers of young children unwittingly foster such an 
attitude when, to avoid ambiguity, they pose questions to which either "yes" 
or "no" is always the correct answer. Thus the child not only has no ex- 
perience in dealing with Indeterminacy, but half the time, by pure chance, 
is reinforced for guessing. The child, from the moment he enters the school 
environment, should be taught to deal with situations which because information 
is Inadequate, ::requlre withholding a decision and seeking further evidence. 
Introducing this kind of training at an early age should contribute to the 
cultivation of inquiry processes. 

It would be a severe limitation if the Instruction i.n withholding judg- 
ment were to be so effective that the child failed to recognize situations 
where guessing is desirable or even necessary. In many life situations it 
is better to make a decisive act than to wallow in indecision. For cixample, in 
objective- type examinations, it is often desirable to make as "educated" a 
guess as possible. Also in many situations such as in the game of "TWenty 
Questions" a tentative guess is the only way in which additional information 
can be obtained. Withholding of judgment should not be permitted to inter* 
fere with the process of hypothesis formulation and testing. 

The ability to withhold judgment Involves the recognition of possibility; 
the child must learn that where more than one eventuality is possible, a de- 
cision must be postponed. In such cases saying "maybe" may be a better 
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alternative than withholding of judgment « The program should be expanded 
to include this addition to the child’s repertoire. 

A third area of curriculum development involved the use of verbal 
quantifiers all , some , and none . The goal was a limited one: to have 

the child understand, i.e., to acquire a listening comprehension of, these 
terms. The child was not asked to draw inferences from the premises in 
which these quantifiers appeared; his task was simply to demonstrate under- 
standing by responding appropriately when the sentences in which the quan- 
tifiers were involved were restated. Paralleling this instruction was the 
introduction of the child to the probability words always , s ometimes , and 
never . A lack of understanding of these important terms may contribute to 
the apparent deficiency in certain listening skills and the inability to 
follow instructions which characterize the school behavior of these young 
children. The significant improvements resulting from this brief program 
suggest that this type of instruction would be appropriate for many kinder- 
garten children. 

Development of Instructional Programs 

A major objective of the project was to carry out experimental treat- 
ments with instructional programs which would be highly replicable and thus 
permit exportation into classroom settings. Over the several studies in 
this project, it was demonstrated that it was possible to maintain experi- 
mental rigor for an extensive period of time through the use of these pro- 
grammed materials. An adequate degree of control was provided through the 
use of individual earphones and dividers. Small groups of children were 
effectively taught listening skills through these lessons, using picture 
books with color feedback and taped commentary. The use of games involving 
manipulanda seemed to be quite effective in improving the child’s under- 
standing of many words such as those conveying the concept of possibility. 

With some adaptation, the techniques as well as the content of the experi- 
mental treatments are suitable for use in a regular curriculum. 

The criterion measures developed as research instruments to test the 
hypotheses of the project served also to provide simultaneous evaluation of 
the effectivenesss of the programs. These assessments provide valuable 
information on which to base decisions about the instructional program for 
the kindergarten. As instruments for the assessment of language competencies, 
these tests may have independent merit. Although they have not yet been 
standardized, several of them seem worthy of further revision and extension 
as test instruments for wider use. 

While the programs were adequate for the purposes of the project, they 
were not by any means the most effective ones possible. With appropriate 
changes, it is likely that they could be sufficiently improved to warrant 
their inclusion within the typical classroom. In fact, a revised version of 
this program is now being incorporated into a two year curriculum in a paral- 
lel project with a similar population. Thus, the research findings of this 
project are likely to be the basis for other innovative applications. 
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APPENDIX 1 



LISTENING TEST ON FOLLOWING INSTRUCTIONS 
WITH SENTENTIAL CONNECTIVES AND SENTENCE FORMAT 

This test was given to the child by showing him a card on 
which pictures had been drawn. He was given oral instructions 
and was also asked to point to the box in which the right picture 
appeared. There were five parts to the test, one part for each of 
the following conceptual rules: affirmation, negation, conjunction, 
disjunction, and joint denial. Each part of the test was prepared 
in four forms varying only in the way in which the specific in- 
struction was presented for the test items proper. In Form A a 
phrase was used containing only the key words needed to identify 
the right box, in Form B a declarative sentence was used, in Form C 
the interrogative was presented, and in Form D the imperative was 

r 

given. Each child was given items for all conceptual rules and for 
all sentence formats but only received one form for any given item. 
In the following two page.s the first part of the test is presented. 

At the left will be found the descriptions of the pictures on the 
cards and on the right side of the page is the commentary read to 
the child. The word describing the correct picture is underlined. 
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APPENDIX 3 



SELECTIVE LEAENING TASK ON A SIZE DIMENSION 

Commentary for Each Day of the Program ; (Day 1 & 2) 

Treatment A-L : Attribute Label-i np^ 

Problem 1 

a. Look at the arrow. The arrow points to the right 
picture. Remember which picture is right. It will 
be right next time too! Its name is Medium. Say- 
Medium. Now point to it. 

b. Find the same one. Say Medium. Point to the same 
picture. 

c. Find the same one. Say Medium. Point to it. 

d. Same one this time. Say its name and point. 

Problem 2 

a. The arrow points to the right picture. It will be 
right next time tpo! Its name is Big. Say Big. 

Now point to it. 

b. Find the same one. Say Big. Point to the same 
pictiir e . 

c. Find the same one. Say Big. Point to it. 

d. Same one. Say its name and point. Let's do another! 

Problem 3 

a. The arrow points to the right picture. Its nama is 
Medium. Say Medium and point to it. 

b. Find the same one. Say Medium and point to it. 

c. Same one. Say its name and point. 

d. Same one. Say its name and point. 
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(Instructions for Problem 3 are repeated for Problems 4-30, 
najning appropriate label.) 

Treatment N-^L : Non-labeling 

Problem 1 

a. Look at the arrow. The arrow points to the right 
picture. Remember which picture is right. It will 
be right next time too! Now point to it. 

b. Find the same one. Point to the same picture. 

c. Find the same one. Point to it. 

d. Same one this time. Point to it. 

Problem 2 

a. The arrow points to the right picture. It will be 
right next time too! Now point to it. 

b. Find the same one. Point to the same picture. 

c. Find the same one. Point to it. 

d. Same one. Point. 

Let's do another! 

Problem 3 

a. The arrow points to the right picture. Point to it. 

b. Find the same one. Point to it. 

c. Same one. Point. 

d. Same one. Point. 



(Instructions for Problem 3 are repeated for Problems 4-30.) 
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Treatment 0-L : Ob.iect Labeling 

Problem 1 

a. Look at the arrow. The arrow points to the right 
picture. Remember which picture is right. It will 
be right next time too! Its name is Cow. Say Cow. 

Now point to it. 

b. Find the same one. Say Cow. Point to the same 
picture. 

c. Find the same one. Say Cow. Point to it. 

d. Same one this time. Say its name and point. 

Problem 2 

a. The arrow points to the right picture. It will be 
right next time too! Its name is Triangle. Say 
Triangle. Now point to it. 

b. Find the same one. Say Triangle. Point to the 
same picture. 

c. Find the same one. Say Triangle. Point to it. 

d. Same one. Say its name and point. 

Let's do another! 

Problem 3 

a. The arrow points to the right picture. Its name is 
Drum. Say Drum and point to it. 

b. Find the same one. Say Drum and point to it. 

c. Same one. Say its name and point. 

d. Same one. Say its name and point. 

(Instructions for Problem 3 are repeated for Problems 4”*30, naming 
appropriate picture.) 
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APPENDIX 4 



CRITERION TESTS FOR ATTRIBUTE LABELING STUDY 

Posttest: (Day 3) 

Problem 1 



j a. Look at the arrow. The arrow points to the right 

picture. Remember which picture is right. It will 
I be right next time too! Now point to it. 

I 

I b. Find the same one. Point to it. 

! c. Find the same one. Point to it. 

i- 

I 

I d. Same one this time. Point. 



e. Same one. Point. 
Problem 2 

a. The arrow points to 

b. Find the same one. 

c. Same one. Point. 

d. Same one. Point. 

e. Same one. Point. 



the right picture. Point to it. 
Point to it. 



(Instructions for Problem 2 are repeated for Problems 3-12.) 



Transfer Test : (Day 4) 

Problem 1 



a. Look at the arrow. The arrow points to the right 
picture. Remember which picture is right. It will 
be right next time too! Now point to it. 

b. Find the same one. Point to it. 

c. Find the same one. Point to it. 

d. Same one this time. Point. 

e. Same one. Point. 
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Problem 2 

a. The arrow points to the right picture. Point to it 

b. Find the same one. Point to it. 

c. Same one. Point. 

d . Same one . 

e. Same one. Point. 



(Instructions for Problem 2 are 



repeated for Problems 3-12.) 



APPEN'DIX 5 
READING POSTTEST 






Item No. 



te-v ^ . 

^ ERIC 



L 



PuDll Booklet 



Commentary 



1 


pretty 


mommy 


Billy 


Mark the word that says 
mommy . 


2 


in 


are 


run 


Mark the word that says 
run. 


3 


Billy 


cats 


likes 


Mark the word that says 
likes . 


4 


happy 


baby 


mommy 


Mark the word that says 
happy . 


5 


in 


is 


was 


Mark the word is . 


6 


kitchen , 


crying 


children 


Mark the word kitchen , 


7 


are 


run 


saw • 


Mark the word saw . 


8 


kitchen 


children 


cats 


Mark the word children . 


9 


pretty 


Billy 


baby 


Mark the word Billy. 


10 


the 


saw 


is 


Mark the . 


11 


saw 


and 


was 


Mark the word was . 


12 


run 


in 


is 


Mark in. 


13 


crying 


cats 


kitchen 


Mark the word crying . 


14 


was 


a 


and 


Mark the word that 
says a. 


15 . 


fast 


a 


cats 


Mark the word cats . 


16 


and 


are 


a 


Mark the word and . 


17 


happy 


crying 


baby 


Mark baby. 


18 


likes 


fast 


the 


mark fast. 
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Reading Posttest (continued) 



Item No. Pupil Booklet Commentary 



19 


saw 


the 


are 


Mark the word are. 


20 


pretty 


happy 


mommy 


Mark the word pretty . 


21 


likes 


Billy 


baby 


Now mark the word that 
is the name of a boy. 


22 


cats 


fast 


children 


Mark the word that tells 
you what animals are 
soft and furry and say 
meow. 


23 


children 


crying 


kitchen 


Mark the word that tells 
you in what room mommy 
cooks dinner. 


24 


pretty 


baby 


crying 


Mark the word that tells 
you who is little and 
drinks milk from a bottle . 


25 


likes 


happy 


fast 


Mark the word that tells 
how you feel when you 
get a present . 


26 


pretty 


mommy 


Billy 


Mark the word that tells 
how a lady looks when 
she wears a new dress. 


27 


in 


run 


and 


Mark the word that tells 
what children do when 
they want to get home in 
a hurry. 


28 


crying 


baby 


kitchen 


Mark the word that tells 
what kind of noise a baby 
makes when he le hungry. 


29 


likes 


cats 


fast 


Mark the word that tells 
how race cars go. 


30 


happy 


children 


mommy 


Mark the word that tells 
you who gives that baby 



his bath. 

112 














appendix 5 



Reading Posttest (continued) 



Item No. 
31 



PuDll Booklet 



Commentary 



32 



33 



34 



35 



36 



37 



(Picture: 1 


the baby Is crying)* 


Read the top words . 


(mommy) 


(dog) (baby crying) 


Mark the picture that 








goes with the words . 


(cats In the kitchen) 




Mark the word that tell 


and the 


In the 


was the 


you In what room the 


baby 


kitchen 


happy 


cats are playing. 


(Billy and baby) 






mommy Is 


Billy and 


the 


Mark the word that tell 


happy 


a baby 


crying 


you who mommy saw . 






cats 




(children crying) 




Mark the word that tell 


the 


the 


mommy 


you what the children 


children 


baby 


Is 


are doing. 


are 


Is 


happy 




crying 


happy 






(mommy and baby) 




Mark the words that tell 


mommy 


In the 


are the 


who mommy likes. 


likes 


kitchen 


pretty 




the 








baby 








(children 


and cats drinking 


Mark the words that tell 


milk) 






you what the children 


mommy 


the 


the 


saw. 


likes 


children 


pretty 




Billy 


saw the 


mommy 






cats 


Is 




(children 


and cats running) 


Mark the words that go 


children 


mommy 


Billy 


with the picture . 


and cats 


was 


saw the 




run fast 


crying 


baby 





*Words In parenthesis describe the picture on the page of the child s 
booklet . 
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Reading Posttest (continued 



Item No 
38 



39 



40 



41 



42 



43 



44 



45 



er|c 






Pupil Booklet 



Billy was happy 
(cats (mommy 
run) and the 
baby) 



(Billy 

happy) 



mommy is pretty 

(children (cats (mommy) 

run) drinking) 



Billy is in the kitchen 
(Billy in (crying (cats in 

kitchen) baby) kitchen) 



Billy saw a happy 
likes baby run 



the cats are in the 
is fast kitchen 



mommy is 
Billy and 



pretty 



tjie baby likes the 
in children 



was 



Billy was 
crying are 



saw 
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Commentary 



Read the words at the 
top - Now mark the 
picture that goes with 
the words . 



Read the top words - 
Mark the picture that 
goes with the words. 



Read the top words - 
Mark the picture that 
goes with the words. 



Read the top words - 
There is a word missing 
Mark the bottom word 
that goes with the top 
words. 



Read the top words - 
There is a word missing 
Mark the bottom word 
that goes with the top 
words. 



Read the top words - 
There is a word missing - 
Mark the bottora word that 
goes with the top words. 



Read the top words - 
There is a word missing - 
Mark the bottom word 
that goes with the top 
words ^ 



Read the top words - 
There is a missing word - 
Mark the bottom word 
that goes with the top 
word. 
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Reading Posttest (continued) 



Item No. 




Pupil Booklet 




Commentary 


46 


run 






Mark the bottom word 




happy 


kitchen 


run 


that is just the same as 
the top word . 


47 


is 






Mark the bottom word that 




is 


cats 


baby 


is just the same as the 
top word . 


48 


children 




Mark the bottom word 




a 


children 


likes 


that is just the same 



as the top word. 

OK boys and girls that' s 
all for now - you' ve all 
done very well today . 
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LIST OF ATTRIBUTES USED IN PROBLEMS 



Animals 

Giraffe 

Monkey 

Elephant 

Camel 

Squirrel 

Bear 

Lion 

Tiger 

Snake 

Owl 

Chicken 

Duck 

Cow 

Horse 

Pig 

Cat 

Dog 

Turtle 

Rabbit 

Frog 

Bees 

Goat 

Butterfly 

Mouse 

Spider 

Fish 

Turkey 

Toys 

Skates 

Whistle 

Blocks 

Jack-in-^box 

Ball 

Teddy Bear 

Bat 

Drum 

Kite 

Balloon 

Ball 

Wheels 

Teepee 

Leaf 

Hammer 

Parts of Body 



Transportation 

Train 

Motorcycle 

Car 

Truck 

Wagon 

Airplane 

Boat 

Bus 

Bike 

School Items 

Crayons 

Blackboard 

Pencil 

Book 

Scissors 

Ruler 

Blocks 

Flag 

Plano 

Food 

Hamburger 

Ice-cream Cone 

Hot Dog 

Pie 

Sucker 

Cupcake 

Peanuts 

Popslcle 

Popcorn 

Coke 

Cake 

Carrot 

Bone 

Playground 

Slide 

Swing 

Rings 

Ladder 

Sandbox 

Pail 

Shovel 



Eye 

Mouth 

Ear 

Hand 

Foot 
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Clothing and Accessories 

Coat 

Dress 

Cowboy 

Hat 

Belt 

Tie 

Shoes 

Gloves 

Umbrella 

Shirt 

Watch 

Glasses 

Earrings 

Necklace 

Policeman 

Spaceman 

Ribbon 

Comb 

Ring 

Pants 

Zipper 

Furniture 



Chair 

Lamp 

Table 

Television 

Bed 

Radio 

Bathtub 

Telephone 

Clock 

Vacuum Cleaner 

Kitchen 

Stove 

Refrigerator 

Toaster 

Plate 

Cup 

Glass 

Spoon 

Fork 

Knife 

Pot 



Fruits and Vegetables 

Apple 
Banana 
Grapes 
Watermelon 



Strawberries 

Tomatoes 

Carrot 

Peaches 
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APPENDIX 7 



RULE APPLICATION TEST 



This test consisted of eight problems; two problems used each of the 
conceptual rules selected* For each problem the child was first 
given a commentary which described a person, animal, or article to be 
found. Then the child was shown a set of five cards, on each of which 
appeared three pictures. (See sample card on next page.) The child was 
required to point to one picture per card. No knowledge of results was 
supplied. The commentary for each of the eight problems is given below; 

except for the first item for Problem 1, the five cards per problem are 
not shown. 



Problem J. Let's help Richard find his sweater. Richard's sweater 
has button s and sleeves . He lost it at the grocery store. Point to the 
one that might be Richard's sweater. (A similar instruction to point was 
given for each of the four remaining items in the problem.) 



Problem 2. Tony is looking for his Mother. She is somewhere at the 

beach. Tony's mother does not wear a watch . Point to the one that could 
be Tony's Mother. 



Problem 3. Let's find the lady who drives the school bus. The lady 
bus-driver wears earrings or a necklace . She also has on boots. Point 
to the one on this page that could be the lady bus-driver. 



Problem 4. Let's find the pig that is named Fatso Pig. He likes to 
lie under the tree. Fatso Pig is wearing a bell and has soots . Find the 
one that could be Fatso Pig. 



Problem 5, Let's find Jimmy's favorite birthday present. The 
birthday cake tasted good. Jimmy's favorite present has no wheels and no 
ribbon. Point to the one that could be Jimmy's favorite birthday 
present. 



Problem 6. Let's find Betty's brother at the Holloween party. He 
has a knife in his pocket. Betty's brother is dressed like a policeman 
or a spaceman . Point to the one that might be Betty's brother. 



Problem 7. Let's help Lilly find her purse. Lilly's purse has no 
handle and no zipper. It has a dollar bill in it. Find the one that 
might be Lilly's purse. 



Problem 8. Who could be Edward's new teacher? The new teacher does 
not wear glasses. He has a ring on his finger. Point to the one that 
might be Edward's new teacher.. 
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APPENDIX 8 

CONCEPT IDENTIFICATION PROBLEM 1 



For this problem, the conceptual rule which the child had to discover 
was Joint denial, specifically NOT THE COMB AND NOT THE RING. The 
commentary below was first read. The child was then sho^ a set of eight 
cards on each of which appeared three pictures, each card representing 
one three-choice item. The pictures used for each card or item are 
described below. On the following page appears the first card (Item 1} 
for this problem. The set of cards was shown the child as many times a 
necessary to reach the criterion of eight successive errorless trials, or, 
in the case of the child not achieving criterion, for 64 trials. 



Commentary : 

Mary Lou went shopping with her mother. They bought many things 
while they were downtown. I will show you some pictures and you can guess 
what Mary Lou and her mother bought. If you p6int to the right | 

will say. "Good, -that's right." If you point to the wrong box, I will 
say, "No, that's wrong." We will keep playing until you guess the right 



pictures. 


I will say when 


to stop. 




Pictures: 








Item 1: 


RING 


COMB 


FLASHLIGHT 


Item 2: 


COMB 


UMBRELLA 


RING 


Item 3: 


SAFETY PIN 


RING 


COMB 


Item 4: 

• • % 


RING 


COMB 


FAUCET 


Item 5: 


COMB 


RING 


ARROW 


Item 6: 


FAN 


COMB 


RING 


Item 7: 


KEYS 


COMB 


RING 


Item 


COMB 


VIOLIN 


RING 






121 







nagan»Kf£aosm!m 





















o 

HH 

I- 

o 



•-0 

00 



o 

00 

00 



o> 

X 

HH 

o 



< 

LU 

o 



o. 

Ou 

<C 



a. 



< 

o 



o. 

o. 

< 



>- 

< 



o 

o 






>- 

o 



o 

< 



< 

c/> 



1^ 







>» 




"O 










•t 


c 


c- 


"o 


(d 0*0 


(U 


(U 




1 — to c 


00 






to 1 — <d 




^ 3 


o 


«d *r- ^ 


Si. 


(U s. 


•M 


3 3 C 0) 


(U 






«t o>+» 


4-> P 


g* 


0) H>4 (O t|_ 


O f 


(U 


Q)= O 


fd 


S 4-> 


Si. 


(d = 






"O 


O • (/) 


c 


CO 




• 0)*r- 


fd 


, 


•r- 


0) 3>) C f 


s. 


P)4-> 




(d *r- 




c fd 


O -M 3 3»»M- 


Si. 


•r* 




•M (d (d o 


(U 


"O 3 



£• 



<U *r- ^ -C 

f •— C Q.-M -M 
4-> 3 3 0 

</) !U M- O Z 
^ &r- O 
(U f O "O 
> -O <U • 

O -M (U Q. E 

^ f ^ ^ Q.*r- 
pi (U *r- Of 
(U 3 -O 4-> f 
rc O T- 

f O -M (U S. 
4-> (U (U f S. 
• ^ o) <d 



=1t5 



o 


0) 3>) 


«| u 


•M 


to C >>•— 1 


>1 


t/1 


3 C C 


c -o 


O 0 ) c s. 


C 


g* 


E 00 0) 0) 


<U 3 


O 


00 -M 00 O 


•r- 


>> •* M- 


U 


4-> 


1— "O >s fd "O 


O 


-o c (d s 


(U </) 




c < -o 


(U Q) 


3 


0 ) «k 


M- (U 


•r^ 


•r- P "O 




CO 


^ • C *r- 


o 


•r- 


M- E O (d -M 1/) 


O 


•r- CO 


•r- 




Id f ^ 


(U f 


M- 


•M (U 


E 


O 


</) 4-> 3 f 


rd CO 




Id P 00 


O (d 


g* 


3 o. 


Si. -M 


o 





(U 

tn 



CO O. 

•r- 

fd 
(U I— 
CO 

3 (O 

o 

s s- 
o 

•M 0) 



^JS 

c o 

(U -M 

00 

<d 

(U 

CO "O 

o c 

Q.«r- 
O-f 
3 (U 
CO f 







3>» 




>» 






Si. 














(U 




c 


c 


c 










(U 


(U 


(U 




c 


•M 




00 


00 


00 




(d 


o 


















"O 


"O 


"O 




Si. 






(U 


(U 


(U 




(U 


(U 




CO 


CO 


CO 




"O 


Si. 




fd 


fd 


fd 




c 


(U 






^z 


^z 




3 






u 


u 


a 






5 












c 






(U 


(U 


(U 




fd 


"O 




> 


> 


> 




0. 


g* 




fd 


(d 


(d 






•r- 




^z 


^z 


^z 




>1 


U. 


















>1 


>1 


>1 




c 


• 




fd 


<d 


fd 




(U 


Q. 




E 




E 




00 


E 














fd 




Si. 


Si. 


Si. 










(U 


(U 


(U 




• 






^z 


^z 


^z 




3 


fd 




•M 


•M 


•M 




o 






o 


o 


o 




c 


S.I 


1 










• 


ol 


1 








CM 


Ol (U 






(U 


(U 


(U 




C 


s. 




Si. 


Si. 


Si. 




•r- 3 


(U 




01 


(U 


(U 


•M 


-o S- 


•M 




^z 


' ^z 


^z 


(U 


•r- 


CO 










00 


f (U 


(d 












•C 


o 




"O 


"O 


"O 




CO 


•M 




g* 


c 


c 




•r- 






•r- 


•r- 


•6" 




>1 


< 


• 


U. 


U. 


u. 




>1 




3>» 










C (/) 














c 


• • 


c 


• 


• 


• 




(U 



c 0) 


c 


c 


c 


00 *1 


•r- 00 


•r- 


•r- 


•r- 




<d 


<d 


cd 


<d 


<U (U 


Old 


C7> 


o> 


Ol 




id^ 0) 


cd 


cd 


cd 


01 



-o 

o 

Si.* 



o • •* <U I/) 

c 4-> (U f O 
C E0 4JM- 
(U "O O O O 

00 c f f s: CO 
(d «d 

(U 0 ) c 

E o E 0) C 

•r- 'r* O f cd 

f C O 5 s- 



^ s 

O 00 
"O 

"O 
0) (U 
^ </) 
0) fd 



CO 

0) <d 






0) 



(U 
(U > 
f <d 
•!-> f 



s. 

(U 



0) 

3 



(U 



0) 



u 

Q) 



■o o 



•1“ (O 



>» >» 
(d (d 
00 E 



>» 

(d 

oo 



>» 

(d 

oo 



>» 

(d 

oo 



I/) 0) 
- $- 
+» ^ 
0) E 



CM 



CO 



lD 



VO 



=3 < 
O Ul 
< —I 

> o 



O 

t— ( 

o 



o 

t-H 

o 



=> < 
O Ul 

5 d 



O 

t— ( 

o 



on 

Ul 



oo 

< 

O 



ZD < 
O Ul 
«C -I 
> o 



oo 

< 

O 



A. 

§ 



=3 < 

O Ul 

5 d 



o 

HH 

o 



CVJ 



CO 



CD 



VO 



123 



r 



I 



ERIC 






'".V.*. »t-3 '> >f£3Jr* »«' 



• •'Tft.'WS^*W''tV.r,T»aSV ■ ■ K* » -Mfci «t It, I 



RULE APPLICATION: SAMPLE OF A LESSON IN DISJUNCTION (P.2) 





















• 














■f 

&. • 1 








3 














*0 0) (U 








S. 














0) f -M E 






















Q.4-> 3 O 








0) 














E O X) f U) 




0) 




> 




• 


*■ 








3 Z (O 




s. 




lO 


• 


c 










•r> 04 J 2 




0) 






c 


Zl 










■0 C 










Zl 


s. 










-Os(U(U(U — 








>> 


s. 












c — ^ $ s. cx 








lO 




0) 










(O >t 0 0 ) 0 ) 




o 




E 


0) 


> 










C 0 T3 f 0) 1 




4-> 






> 


Id 










4-> C 1 — P 1— 1 — 








>» 


lo 


43 










(o 0) (b (o i 




4-> 






JZ 












(0 00 ^0 Pb ^ 




c 




c 




>» 










Q. C Q.C» 


>- 


•r^ 




0) 


>, 


Id 










<0 3 0)^ 


oc 


o 




00 


rd 


E 










■0 — ■ E C 


< 


OL 






E 












0 ) >>^ 0 ) 0 3 


1- 






0) 




>> 










0 . C 0) > f 0 1 


3jg 






s. 














Q. C jMf <0 (O 


Ul 


• 




0) 


c 












•f- <U 0 014J 


s 


•o 






c 


0) 










1 — 00 0 0 • • 


SEZ 


0) 




s 


0) 


00 










(OS i— S. O) 0) 


o 


X) 






00 












0) Ot 


o 






0) 




0) 










0) 0) f 0) <b 1 




lo 




E 


0) 


s. 










f f <MZ U ^ 










s. 


0) 










■0 to 0 (O 


IjJ 


s. 




3 


0) 


43 










4-> 0) Z (U 


3Z 


o 




o 


43 










• • 


3jQCi— 


O 


















>> 


jQ ? f> 0) <P 1 








to 




o 








S. 


i- • >»Z 4-» 


ijJ 








•o 


4-> 








o 


>> 01 <U 1 — 3B ••- 1 










c 










4-> 


c 2 ^ ^ 




0) 




• 


*r^ 


4-> 








cn 


COO) (b'o 1 




s. 




c 


U. 


c 










0) i— f C C (O 


>• 


X) 




*r^ 




*r* 








cz 




Cl£ 


E 








o 








o 


^ U- 0 f i 


o 


3 


• 


o> 


• 


D. 








fr* 


t. 0) U «f- 


h- 




c 


fO 


c 










4-> 


0 JZ ns c t 




C 


3 




*r^ 










U 


(L- AJ 0 . fll .1— 


o 


< 


S. 


0) 


Id 


r-» 








c 


>>JC I 


ZD 








Ol 


0) 








zs 


*0 0 Oi C (O cx 


< 




0) 


3 


Id 










•o 


0) 4-> E c= 3 1 




• • 


> 


S. 




Zl 








c: 


JZ C 0 0)Ji£ 1 




c 


(0 




0) 


s. 








•r^ 


0 T* t) 00 c -o 1 




*r^ 


JZ 


0) 












O 


ns *f- 0) ;l 




<0 








0) 










0)2 3’T3J=I— 




or >» 


4-> 


s. 










M- 


S. 0 0 C 4-> S. 






(0 






4-> 








O 


■0 >- *f- 3 .’1 






E 


0) 


0) 












t. C s «f. 3 U 




4-> 




E 


43 


CO 








c 


0) . 1 - 3 1 




•1“ 






4-> 










o 


^2 4J >»r^ 1 












4-> 








•r* 


4J • 0 r- ■ 1 




>» c 


r" 


>> 


Id 








(A 


0 0) *0 c 0 (b ;i 






0) 


0) 


Id 


43 








Z» 


Z f 0) -o J 




to CO 


1- 


to 


3* 










4-» 4-» -O >» 1 




















u 


3 1— & 1 




















c 


4-> 0 3 (b C 




• 




• 


• 


• 








o 


3 f Of 01 








00 


a> 


O 








o 


0 (O 0 3 00 
































< 












1 


















<D 




1 














o 




< 




J; 




ijj 




UJ 


UJ 








-J 














a: 








U- 




1 




00 




00 


00 




H- 4 








•1 




JSC 




«a: 


s 


UJ| 


CL 


o 




1 


1 




h“ 




1- 


ZD 


001 




o 


ol 


1 
























4 














o| 


1 O 


to 




’J 


















2Z 


















to 




1 o 




■I 




< 










to 


ol 


1 ^ 






•J 












UJ 




, ^ 




) 


< 












OL 


>1 


oo 








UJ 




UJ 


UJ 


UJ 


o 


l-l 


1 o 




1 


C/> 


a: 




> 




> 










'.1 




00 




o 




o 










'1 










< 




CO 




in 












C0 


1- 


Cd 




=»*a 


Stfe 


















4-> 


•M 


•M 




1 

j 














0) 


0) 


0) 


















to 


to 


to 




J 




UJ 






UJ 


UJ 










1 




> 




1 


















o 




s 


o 

-J 












-'1 




C0 




ooi 


C0 


1- 










n 














LO 


o 


«cn 






UJ • 














CM 






W 


z o 






• 


• 


• 


1 


1 


i.l 






< z 






00 


a\ 


o 




CO 








z 












fmm 




CM 







r 



124 




V. . iAtu:SM>\ < ps ' • » ^ : i f- r / 1 ( . 54! <. * e- P n'nt* w - w. v " 
















•J 

,v 



r 

r 



I 

r 



I 

I 

I 



S' 









Text: Here Is a cat in a box. Is there anything else in the box? 




yes 




no 




? 


Text: This boy is hiding 


from his brother. Is 


he 


under the table? 
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APPENDIX 11 

LISTENING INFERENCE: POSTTEST (P.l) 




LISTENING INFERENCE: POSTTEST (P.2) 
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LISTENING COMPREHENSION: LESSON 6 (P.2) 
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Is the frog behind the rock green? 

Mark the answer. BELL 

Let's look. (T. LIFTS FLAP) What color is the frog? 




LESSON 17: LISTENING COMPREHENSION OF VERBAL QUANTIFIER SOME (NON-ORAL-2) 
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APPENDIX 16 

NATURE STUDY PROGRAM: POSHEST (P.l) 




NATURE STUDY PROGRAM: POSTTEST (P.2) 
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RULE APPLICATION: SAMPLE LESSON (ORAL-1) 
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APPENDIX 18 

RULE APPLICATION: POSHEST (P.l) 
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